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In This Issue 


This issue of the Survey Methodology journal opens with a special article to honour the memory of 
M.P. Singh, the founding Editor who led the journal for thirty years to its current stature as an 
internationally recognized source for new developments in survey methods and methods for production of 
official statistics. In this article many of M.P.’s closest colleagues and friends from over the years share 
their memories of him, and reflect on his career and his contributions. 

In the first regular paper of this issue, Thompson discusses random walk designs for sampling from a 
networked population. He shows how this approach can lead to network samples where the inclusion 
probabilities can be estimated independently of how the initial sample of nodes is chosen, leading to valid 
design-based inference methods. Selection preference can be given to certain types of nodes or graph 
characteristics through choice of the random walk mechanism. He describes both uniform and targeted 
random walk designs, and presents some examples for illustration. 

Durrant and Skinner consider the use of imputation and weighting to correct for measurement error in 
the estimation of a distribution function. They consider various nearest neighbor and hot-deck imputation 
methods, and propensity score weighting under different response models. They discuss the theoretical 
properties of these methods, and compare them via simulations to estimate the distribution of hourly pay 
based on United Kingdom Labour Force Survey data. They conclude that an approach based on fractional 
imputation seems best overall in terms of efficiency and robustness. 

Harms and Duchesne look at the problem of estimation of quantiles using survey data. They calibrate an 
interpolated estimate of a distribution function to given quantiles of an auxiliary variable, and then invert 
the resulting calibrated interpolated estimator of the distribution function of the variable of interest. They 
compare their approach with other methods in a simulation study. 

In their paper, Haziza and Rao propose a new regression imputation method that uses the response 
probabilities. The new method leads to valid estimators under either the nonresponse model approach or the 
imputation model approach. In the nonresponse model approach, the response mechanism is parametrically 
modelled and is not restricted to the uniform nonresponse model, while in the imputation model approach 
the variables of interest are modelled and nonresponse is assumed to be ignorable. The authors also provide 
estimators of the variance under their imputation method. Simulation results for both point and variance 
estimation are reported that show the good performance of the proposed regression imputation method. 

The paper by Zanutto and Zaslavsky deals with the problem of estimation in the U.S. decennial census 
of population under sampling for nonresponse follow-up. Instead of trying to obtain information from all 
nonrespondents, a sample is drawn for follow-up, thus creating a small area estimation problem. The 
proposed strategy consists of predicting the number of nonrespondent households in different categories 
using a hierarchical loglinear model and then imputing detailed person and household information using 
donor imputation. The idea in the first step is to model household characteristics using low-dimensional 
covariates at detailed levels of geography and more detailed covariates at higher levels of geography. The 
performance of the proposed model compares favourably to other models in a simulation study. 

In Théberge’s article, a new approach is proposed for 2006 Reverse Record Check (RRC) sample 
allocation for measuring census undercoverage and a part of overcoverage. RRC estimates are used 
together with census counts to produce population estimates which will be used in calculating Canadian 
federal government equalization payments to the provinces. The proposed approach will provide an 
allocation that achieves the proper balance between four objectives. It first consists of establishing a 
separate allocation for each objective. Then, by province, the maximum sample size is used for each 
allocation. Finally, the RRC’s sub-provincial sample allocation is obtained by using calibration to smooth 
the stratum-level parameters. 


5 In This Issue 


In his paper Longford discusses how to design a survey when estimates are required for a number of 
small areas, with possibly different priorities for different small areas, by minimizing a weighted sum of 
expected variances. He first develops his ideas for direct estimation, and then extends to composite 
estimation that combines the direct estimator with a synthetic estimator. The approach is illustrated by the 
resulting sample allocations, under various assumptions, to cantons in a Swiss household survey. 

You and Chapman propose a Hierarchical Bayes estimation approach for small area estimation when the 
sampling errors of direct estimators are estimated. They demonstrate the approach by producing small area 
estimates from two data sets and investigate the sensitivity of their approach to model assumptions. 

Khoshgooyanfard and Monazzah compare synthetic, composite and Empirical Bayes small area 
estimation methods for producing intercensal estimates of unemployment rates for provinces in Iran. They 
find that both composite and Empirical Bayes approaches lead to satisfactory results. 

The short note by Gabler, Hader and Lynn, the last paper in this issue, provides an interesting extension 
to the earlier paper by Gabler, Hader and Lahiri that appeared in Survey Methodology (1999). It offers a 
practical solution for obtaining design effects when different exclusive domains use different sample 
problems. 

Finally, we note that Survey Methodology is now available on-line in a fully searchable pdf format. All 
articles published in the journal are now being made available free of charge directly on the Statistics 
Canada web site upon release. There are also plans to include past issues. All the articles from the latest 
seven issues have been posted, and work is in progress to add those of the previous 10 years. Printed copies 
of the journal will still be produced for subscribers. Older issues can be obtained upon request in paper or 
pdf scanned formats. The journal can be accessed from Statistics Canada’s web site at www.statcan.ca/ 
bsolc/english/bsolc?catno=12-001-X. 


Harold Mantel, Deputy Editor 
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M.P. Singh Remembered 


Introduction 


Don Royce 
Statistics Canada 


In August of 2005 the world of survey methodology lost 
one of its leading figures with the death of Dr. M.P. Singh at 
the age of sixty-three, just a few months short of his planned 
retirement. M.P. and I had discussed his upcoming retire- 
ment only briefly, but it was intuitively clear to both of us 
that he would continue as the Editor of Survey Methodology 
even after he left Statistics Canada. Survey Methodology 
was a part of his life, and I was only too happy to offer M.P. 
the chance to work part-time from his family’s home in 
Toronto so that he could continue to nurture the journal that 
he had led for over thirty years. Sadly, this arrangement 
never came to be realized. 

In the series of articles that follow, many of M.P.’s 
closest colleagues and friends (the two are indistinguish- 
able) recall M.P. Singh the statistician, editor, collaborator, 
leader, and human being. I am deeply indebted to Eric 
Rancourt of Statistics Canada for suggesting this series of 
articles, and to all of the authors who gave their time and 
talents to put into words their memories of M.P. Singh. 
Although words can never completely capture the essence 
of a person, the articles that follow do a marvellous job of 
describing the life of M.P. Singh and remind us of the 
legacy he left to all of us who were fortunate enough to 
know him. We hope M.P. would be pleased. 


Some Reminiscences 


J.N.K. Rao 
Carleton University, Ottawa 


I first met Mangala Prasad Singh (fondly known to many 
of us as M.P.) in 1968 while I was a visiting professor at the 
Indian Statistical Institute (ISI), Calcutta. M.P. was a Ph.D. 
student at the ISI working under the supervision of M.N. 
Murthy. While doing his Ph.D. he also worked in the 
National Sample Survey (NSS) of India. NSS was located in 
the ISI campus and M.P. worked under renowned survey 
statisticians at the NSS and ISI including P.C. Mahalanobis, 
D.B. Lahiri and M.N. Murthy. He received solid training in 
both design and theory of sample surveys. M.P. made good 
use of that sound training throughout his illustrious career 


by following the principles of efficient design subject to cost 
and operational considerations and insisting on sound theory 
before implementing new survey designs or redesigning 
continuing surveys such as the Canadian Labour Force 
Survey (LFS). 

A major part of M.P. Singh’s thesis was on the efficient 
use of auxiliary information. He studied the case of two 
auxiliary variables, one positively correlated and the other 
negatively correlated with the variable of interest, and 
developed ratio-cum-product estimators of totals. Murthy 
(1967) devoted a section in his well-known sampling book 
to ratio-cum-product estimators. M.P. published several 
papers on the efficient use of auxiliary information based on 
his thesis work: ratio-cum-product estimators (Metrika 
1967; Sankhya 1969), multivariate product estimation 
(Journal of the Indian Society of Agricultural Statistics 
1967) and systematic sampling in ratio and product 
estimation (Metrika 1967). He also published an important 
paper in the Annals of Statistics, 1967 on the relative 
efficiency of two-phase sampling strategies under a super- 
population model. The first phase consisted of simple 
random sampling to collect data on an auxiliary variable x 
that was used at the second phase to select a PPS sample 
without replacement and collect data on the variable of 
interest, y. 

M.P. was also dabbling with inferential issues in survey 
sampling at the time of my visit to ISI and he encountered 
technical problems in proving some admissibility results: 
An estimator is admissible in a class of unbiased estimators 
if no other estimator in the class is uniformly more efficient. 
Unfortunately, the criterion of admissibility is not suffi- 
ciently selective and as a result other admissibility related 
criteria for unique choice were proposed in the literature. I 
was also interested in inferential issues at that time and this 
led to our collaboration on admissibility related topics. The 
resulting work constituted a part of his Ph.D. thesis. We 
ultimately published a paper based on this work in the 
Australian Journal of Statistics, 1973 based on our 1969 ISI 
Technical Report. Our results demonstrated the practical 
irrelevance of a criterion called hyper-admissibility that 
leads to the Horvitz-Thompson (HT) estimator of total as 
the unique choice for any sampling design. Subsequently, 
D. Basu obtained similar results independently in his 1971 
landmark paper on inferential issues, and his famous 
example of circus elephants put a stop to research on 
unrealistic criteria that lead to unique choice for any design. 
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M.P. also showed that hyper-admissibility when applied to 
variance estimation leads to a “bad” variance estimator as 
the unique choice. 

Soon after joining Statistics Canada in 1970 as a 
Methodologist, M.P. was actively involved in the redesign 
of the LFS that led to several innovations. M.P. proposed 
the use of systematic PPS sampling without replacement 
with initial randomization for selecting the primary units 
from the non-self-representing units (NSRUs) and _ the 
random group method with one primary unit from each 
random group selected by PPS sampling from the self- 
representing units (SRUs). In the 1960s I studied those 
methods theoretically from the point of view of efficiency 
and variance estimation. M.P. on the other hand recognized 
their practical advantages in the context of LFS. Both 
systematic PPS sampling and random group method 
permitted sample expansion as well as easy rotation of 
sample primary units over time and the random group 
method enabled the adaptation of Keyfitz’ ingenious 
method for changing out-dated size measures within each 
random group. A joint paper with Dick Platek on updating 
size measures was published in Metrika, 1975. The LFS 
group under the able guidance of M.P. made several 
methodological advances to improve the efficiency of the 
design as well as estimation. Given M.P. Singh’s past 
interest in the effective use of auxiliary information, the LFS 
switched to generalized regression estimation to accom- 
modate several post-stratification variables. The LFS group 
also was the first to recognize the merits of re-sampling 
variance estimation and the jackknife was adopted for 
variance estimation. More recently, regression composite 
estimation was introduced in the LFS under M.P. Singh’s 
leadership, using a method suggested by Wayne Fuller and 
myself that is good for both change and level estimation. 
This method and an earlier method of Avi Singh fit in well 
with the existing LFS estimation system based on gener- 
alized regression. Three papers on regression composite 
estimation for LFS, including a joint paper of M.P. with 
Jack Gambino and Brian Kennedy, were published in the 
June 2001 issue of Survey Methodology. 

M.P. also had a keen interest in small area estimation, 
dating back to 1976. His team made important method- 
ological contributions to small area estimation. M.P. and his 
colleagues proposed simple synthetic estimators as well as a 
new estimator called the sample dependent estimator. The 
latter estimator is a simple composite estimator with weights 
designed to account for realized sample sizes smaller than 
expected sample sizes in the areas. Sample dependent 
estimators became quite popular and many agencies world- 
wide have used them. M.P. Singh’s 1994 joint paper in 
Survey Methodology with Jack Gambino and Harold Mantel 
addresses several practical issues pertaining to small area 
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estimation. I particularly like the section on design issues. It 
presents an excellent illustration of compromise sample 
allocation in the LFS to satisfy reliability requirements at the 
provincial level as well as sub-provincial level. A section in 
my 2003 Wiley book on Small Area Estimation is devoted 
to design issues largely based on the 1994 paper. M.P. 
played an active role in organizing a highly successful 
international conference on Small Area Estimation in 1985 
and acted as co-editor of a 1987 book Small Area Statistics 
published by Wiley based on the invited papers presented at 
the conference. 

M.P. thoroughly enjoyed working as Editor-in-Chief of 
Survey Methodology. He maintained close contact with his 
team of Associate Editors and introduced many innovative 
ideas including theme papers on both theory and practice 
and the Waksberg series of papers. The luncheon gatherings 
M.P. organized at the Annual Joint Statistical Meetings 
were always a big hit with the Associate Editors! As an 
Associate Editor located in Ottawa and consultant to 
Statistics Canada, I had many conversations with M.P. on 
matters related to the journal over the past 25 years. M.P. 
also played an active role in the Statistical Society of 
Canada (SSC) and he was instrumental in raising the profile 
of survey sampling at the SSC Annual Meetings. 

M.P. was remarkably accurate in palm reading. In 1999 
he read my palms and warned me of health problems. 
Indeed, I faced an unexpected health problem in 2001 due to 
complications from appendicitis. A few months before 
M.P.’s death, Avi Singh told me that M.P. had read his own 
palms and predicted recovery from his serious health 
problems. Both Avi and I were very confident that we 
would see M.P. back at work. However, it is a common 
belief in India that palmists reading their own hands cannot 
predict their futures accurately. Unfortunately, this belief 
proved to be true in this instance. 

M.P. was truly a great friend of mine and I will miss him 
very much. It is fitting that his ashes were immersed in the 
sacred river Ganges in the holiest city for Hindus, Varanasi 
(also called Benares), where M.P. was born. His soul has 
gone to Heaven but his legacy will remain with us. 


M.P. and his Research Days 


T.J. Rao 
Indian Statistical Institute, Kolkata 


I had first met M.P. when he came to attend the Fourth 
Summer Course (Advanced) for Statisticians organized by 
the Research and Training School (RTS) of the Indian 
Statistical Institute (ISI) in May—June 1964 at the University 
of Kerala in the South Indian city of Trivandrum (now 
Thiruvanathapuram). This course was meant for research 
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scholars and junior faculty of ISI and other Universities. 
M.P. came from the Benares Hindu University (BHU) 
where he was a temporary lecturer. He obtained his 
Bachelor’s degree in Statistics from the same University 
(BHU) and a Masters from University of Poona. I was 
among the research scholars that were selected from ISI for 
this course. We did not have much interaction during the 
course. 

A little later, M.P. was offered a job in the Sampling 
Division of the National Sample Survey (NSS) Department, 
which at that time was part of ISI. Professors D.B. Lahiri, S. 
Rajarao and M.N. Murthy among others were already 
heading several divisions of NSS by then. Besides being 
occupied with the designing of the large scale sample 
surveys conducted by NSS, M.P. spent his spare time on 
research problems in sample surveys. Lahiri and Murthy 
encouraged methodological research in the NSS and had 
started a seminar series as well as release of technical 
reports similar to the RTS technical reports of ISI. M.P. and 
I spoke on our research on sampling problems in these 
seminars organized by NSS as well as RTS. Most of the 
work of M.P., which he made into technical reports of the 
NSS Series, got published later on in well known journals. 

With his expertise in the NSS on multi purpose surveys, 
he got interested in the problems of utilization of auxiliary 
information in sample surveys. His early work related to 
ratio and product methods of estimation. M.P. successfully 
and intelligently considered the case of multiple auxiliary 
variables of which some are positively correlated and some 
negatively correlated with the study variable and used ratio 
estimators for the former and product estimators for the 
latter and produced the “ratio cum product estimator” 
(Singh 1967). This paper is often quoted and several 
scholars, especially from India, published extensions. 
Jointly with M.N. Murthy, he developed interesting 
concepts of admissibility of estimators (Murthy and Singh 
1969). During the year 1968, Professor J.N.K. Rao visited 
ISI and we were very fortunate to have interaction with him. 

M.P. was very much interested in attending conferences. 
He never missed any at his alma mater BHU nor the 
sessions of the Indian Science Congress. He took the task of 
writing his thesis very seriously and used to have 
discussions with Professors M.N. Murthy, J.N.K. Rao and 
D. Basu. He submitted his research work as a Thesis (Singh 
1969) for the degree of Doctor of Philosophy (Ph.D.) of the 
Indian Statistical Institute in 1969 under the general 
guidance of M.N. Murthy. He left the NSS and ISI in 1970 
to join Statistics Canada. 

All the research scholars of ISI during 1965-70 and his 
colleagues at the NSS miss him very much. 
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M.P. Singh 


Nanjamma Chinnappa 
Statistics Canada (retired) 


While many know M.P. the statistician and of his 
achievements in statistics, I will try to write about M.P. the 
man. 

I had not met M.P. until I came to Canada, although I had 
heard that he was the young man appointed in my position 
when I resigned my job at the National Sample Survey 
(NSS) department of the Indian Statistical Institute in 
Kolkata, India. I heard that when Dr. M.N. Murthy (then the 
head of the Methodology area in the NSS) sent me the draft 
of his book Sampling Theory and Methods for review, M.P. 
was the one who read my comments and discussed them 
with Dr. Murthy. Much later, when Dr. Murthy heard that I 
was hired by Statistics Canada, he gave me M.P.’s tele- 
phone number in Ottawa. So, when we arrived in Ottawa, I 
called M.P. from the hotel we were put up in and to my 
surprise he drove to the hotel on a cold, damp morning in 
late September and took me to Statistics Canada. That warm 
and friendly gesture brightened my day and my introduction 
to Statistics Canada. 

M.P. hailed from the ancient city of Benares in India and 
it would appear that some of the qualities for which that city 
is famous had rubbed off on him. He was gentle, friendly to 
all, unflappable, resilient and wise. Many have told me how 
he was never too busy to listen to their problems and always 
helped with kind words and suggestions. Many young 
statisticians have benefited from his advice related to their 
research and career. 

M.P. was fond of classical Indian music and dance. A 
family-oriented man, he was a pillar of strength for his wife 
and children during their times of need. At social gatherings 
he was full of fun and laughter. And when he first fell 
seriously ill some years ago he told me that it was his faith 
in God and in himself that helped him to recover. He will 
long be remembered, not only as a statistician of repute but 
as a good man who befriended and helped many. 
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A Career in Survey Methodology 


Gordon Brackstone 
Statistics Canada (retired) 


M.P. Singh spent almost his whole career in the 
methodology area of Statistics Canada. He joined the 
organization in 1970, after obtaining a Ph.D. in survey 
sampling from the Indian Statistical Institute. At the time of 
his death he was Director of the Household Survey Methods 
Division in the Methodology Branch. His rise through the 
organization was steady rather than meteoric: he became a 
section Chief in 1973, an Assistant Director in 1982, and a 
Director in 1994. This steady progression mirrored his 
approach to survey methodology which valued thorough- 
ness in research and testing to build firm foundations for 
implementation and further improvement. 

Our careers at Statistics Canada coincided, give or take a 
year at either end, and intersected frequently, particularly 
from 1982 onwards. In the early 1980s when we felt the 
need to improve integration and oversight of Statistics 
Canada’s methodology research work, there was little doubt 
in my mind who we would ask to head this effort and M.P. 
was duly appointed as the first Chair of the Methodology 
Research Committee. In this role until 1987 he initiated the 
planning processes and reporting requirements that, with 
further improvements from his successors, have governed 
the management of methodology research for two decades. 
It was during this same period that Statistics Canada’s 
annual methodology symposia became established, with 
M.P. playing a key role in several of the earliest symposia 
(and many more subsequently). 

In his long career at Statistics Canada, M.P. was involved 
in a broad range of methodological work, but his name will 
always be most closely associated with two projects: the 
design of the Canadian Labour Force Survey (LFS), and the 
Editorship of the journal, Survey Methodology. 

The LFS provides the foundation for Statistics Canada’s 
household survey program. Not only is it the source of 
monthly estimates of labour market conditions in Canada, 
but its frame is also the sampling basis for many other 
household surveys, including several longitudinal surveys 
introduced in the 1990s. Its efficient design is therefore 
crucial to the cost-effectiveness of Canada’s social statistics 
program. First introduced in 1945, the LFS has typically 
undergone at least a sample redesign after each decennial 
Census. M.P. happened to join Statistics Canada just in time 
for the major post-1971 Census redesign. This redesign 
encompassed not only the sampling scheme, but also the 
questionnaire, the methods of collection, and the processing 
systems. Such a major redesign required extensive inter- 
disciplinary project teamwork and M.P. became a key 
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player in the methodological aspects of this redesign. His 
papers from that period focus on optimizing the multi-stage 
design and updating the sample. He was co-author of the 
official description of the methodology of the Canadian 
Labour Force Survey (Platek and Singh 1976). 

Following this redesign pressure to produce labour 
market estimates for smaller regions increased. This lead 
him to develop methods for small area estimation from the 
LFS (Drew, Singh and Choudhry 1982). By the time of the 
post-1981 Census redesign, M.P. had become the Chair of 
the Redesign Committee responsible for oversight of the 
whole redesign. In addition to the usual sampling efficiency 
objectives, this redesign aimed to produce better sub- 
provincial data and to enhance the role of the LFS as a 
vehicle for conducting other household surveys. Naturally 
M.P. was again a principal author of the description of the 
new design (Statistics Canada 1990). 

The efforts to make the LFS frame a basis for other 
household surveys were so successful that by the late 1990s 
a problem of overload had arisen. With the introduction of 
longitudinal surveys in addition to the regular survey 
program, concerns over the burden on the frame were 
increasing. In addition, the need for more targeted survey 
frames for certain sub-populations was being felt. M.P., set 
about finding alternative approaches, including approaches 
that would take advantage of the address register being 
developed for Census purposes. Some of these approaches 
were incorporated into the post-2001 redesign of the LFS 
that was just being introduced at the time of his death; some 
more ambitious ideas for a new frame for household surveys 
are still under consideration by his successors. 

For more than 30 years M.P. guided methodological 
input to the LFS. His many papers, often co-authored with 
his staff, bear witness to his lasting imprint on the design of 
this flagship survey, and his guidance of many younger 
Statisticians in the early stages of their careers. 

Over this same period, M.P. also bore another heavy 
responsibility as Editor of Survey Methodology. The evo- 
lution of this journal from its inception in 1975 to its 25 
Anniversary has been described by its founder, Richard 
Platek (1999), who had the foresight to appoint M.P. as its 
first Editor. 

Under M.P.’s leadership the journal passed many 
milestones. In 1982 it became an official Statistics Canada 
publication — fully bilingual and priced. Authorship was 
expanded beyond Statistics Canada employees; a highly 
qualified panel of associate editors was recruited; theme 
issues were introduced, often attracting the best papers from 
a recent conference or symposium; the Editor’s Jn This Issue 
feature was introduced to provide an overview of content; 
special 25" anniversary issues were published in 
1999 — 2000, along with an index for Volumes 1—26. Over 


Survey Methodology, June 2006 


this period, arrangements were negotiated, firstly with the 
International Association of Survey Statisticians and later 
with other statistical societies, to provide discounted 
subscriptions. More recently electronic versions of the 
journal have been made available. 

Throughout these developments M.P. was at the helm, 
planning future issues, on guard for interesting research 
worthy of inclusion, encouraging potential authors, 
recruiting and pestering associate editors through the ref- 
ereeing process, working with Statistics Canada’s public- 
cation and marketing staffs to improve and promote the 
journal. On the journal’s Management Board from 1987- 
2004, I witnessed first-hand and admired his enthusiasm and 
perseverance in the face of many difficulties. It was for him, 
I believe, a true labour of love. 

These brief descriptions of just two of M.P.’s many 
contributions to Statistics Canada and the statistics 
profession cannot do full justice to his career. I hope they 
give an impression of an ever dependable professional who 
combined a deep understanding and research ability in 
statistical methods with an appreciation of the practical 
constraints of applying statistical methods to surveys. His 
style was based on reason and persistence, without bluster 
and shunning confrontation, coupled with an innate concern 
for the feelings of others. It was always a pleasure to work 
with M.P. and an honour to be associated with his 
accomplishments. 
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In Memory of M.P. Singh 


Fritz Scheuren 
2005 President, American Statistical Association 


In M.P. Singh last summer we lost an individual known 
throughout the whole statistical world as a scholar, a 
gentleman, and a doer. When I spoke about him at the fall 
2005 Statistics Canada Methodology Symposium, it was 
from this perspective. 
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I will be brief however, providing only a sample of what 
could be said. Others are writing too. I will leave it to them 
to say more. 

My memories of M.P. go back over 20 years. Exactly 
when we first met is now obscure to me but I have been one 
of his associate editors (AE’s) at Survey Methodology for at 
least that long. 

He used to like to have me look at papers on record 
linkage, sometimes sample weighting or estimation, and, 
less commonly, on missing data topics. His selections were 
ones I invariably learned from. By and large, after his initial 
screening, the incoming quality was excellent and, working 
under him my job was to make sure that the journal versions 
that eventually resulted were even better. 

His editorship of Survey Methodology was challenging. 
The Journal had to have closely argued mathematical 
statistical formulations but these also had to be ones that 
could be put into practice. In other words the ideas had to be 
very good, as well as eminently useful. And they have 
consistently been both. No mean feat. 

Many outstanding younger professionals, when they first 
submit a paper, demonstrate just one of these two attributes 
in their submissions, usually the mathematical side of their 
topic. For submissions that achieved at least one of these, 
my interpretation of the goal M.P. set for his AE’s was to 
help authors, through the referee and AE comments, to 
achieve the second goal too. And what a journal he created 
with his vision! 

By the way, he suggested that I might have tended to 
overdo my author support role but I think that secretly he 
was pleased with my approach of never giving up on what 
could become a great paper, if given patience. And there 
were several papers I handled that his patience was tried but 
eventually rewarded in the end. 

M.P. had toughness, though, that complemented his 
unfailing gentleness. He firmly held all of us to high 
standards in guiding Survey Methodology with a sure hand. 
Even when his health began to fail, his spirit always 
remained visible. 

The one word summary I used to characterize M.P. at the 
fall conference was to call him a “Mensch.” Now this 
German word for “person” may be familiar to many of you 
in its Yiddish sense of a complete or whole human being. 
But frankly “Mensch” is really untranslatable. That is why it 
has stayed in Yiddish here (although I have not written in 
Hebrew letters, as would have been appropriate). Certainly 
no simple definition can do justice to either the word or the 
individual that M.P. was. 

We all miss him greatly. He was a good friend, a loving 
family man, open to new ideas, careful in his advice about 
practice and rigorous in his thinking. M.P. will forever be a 
model of what it means to be a sampling statistician. 
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Some Recollections of M.P. Singh 


David A. Binder 
Statistics Canada (retired) 


My memories of M.P. Singh over the many years that I 
knew him are all very fond. His strengths, both as an 
outstanding survey statistician, and as a kind and gentle 
person, were characteristics that were unmatched. 

It was in the summer of 1970 when I first met MP. 
Singh. I was working as a summer student in Agriculture 
Division at Statistics Canada. M.P. Singh and J.C. (John) 
Koop were the methodologists working with Agriculture 
Division at the time. I was sharing an office with Jack 
Graham who was on sabbatical leave from Carleton 
University. Jack’s comment to me at that time was how 
fortunate Statistics Canada was to have M.P. and John there 
as survey methodologists, as they were two of the finest 
survey statisticians in the world. In fact, it was such 
outstanding talent at Statistics Canada that helped me decide 
that it would be a good place to start my career. 

Most people knew M.P. through his dozens of published 
papers, his stewardship of the journal, Survey Methodology, 
and his interventions at statistical conferences. His public- 
cations included papers on household survey designs and 
redesigns, estimation (including composite estimation and 
domain estimation), small area estimation, and nonresponse 
adjustment. His insights into the many complexities of 
survey methods were often reflected by his questions and 
suggestions at conferences and meetings. 

He also co-edited monographs on panel surveys 
(Kasprzyk et al. 1989) and on small area statistics (Platek 
et al. 1987), and he wrote a review article on Survey Meth- 
odology in the Encyclopedia of Statistical Sciences (Singh 
1988). 

As editor of Survey Methodology since its inception in 
1975, M.P. oversaw the evolution of the journal from its 
beginnings as mainly a vehicle for staff at Statistics Canada 
to publish their research to a top international journal with 
regular contributions from around the world. Survey 
Methodology has been adopted by the Section on Survey 
Research Methods of the American Statistical Association, 
and by the International Association of Survey Statisticians 
as a publication for members of those organizations. This is 
a reflection of the many years of M.P.’s “labour of love” on 
the journal. His gentleness and kindness were even reflected 
in his encouraging remarks when writing a letter of rejection 
to authors! 

Over the years M.P. was a leader in adapting to the 
changing technology for households surveys. He always 
pursued ways to improve data collection methods. He guided 
Statistics Canada though the world of face-face interviewing, 
into telephone interviewing, and computer-assisted methods. 
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Most recently, he was keen to develop methods to improve 
efficiency by introducing the concept of a master sample for 
household survey designs at Statistics Canada, and he was 
instrumental in convincing managers from across Statistics 
Canada of the potential merits of this concept. 

M.P. was a major influence at Statistics Canada to ensure 
the quality and the stature of research in Statistical Methods. 
The Bureau’s accomplishments in this area have received 
recognition from around the world, and Statistics Canada is 
now often asked to participate in research activities, such as 
presenting invited papers at meetings, participating on panel 
discussions, and joining various advisory committees and 
panels. To help achieve this stature, the Methodology 
Research Committee was created in 1982-1983, with M.P. 
as its first chair. There he helped develop a research agenda 
and a strategic plan for the Methodology Branch. Although 
the research agenda has changed over time, the Meth- 
odology Research Program is still flourishing, thanks to the 
management structure and support that M.P. helped put in 
place. 

Throughout my career at Statistics Canada, I was able to 
benefit greatly from M.P.’s presence. At management 
meetings and at meetings where he represented Meth- 
odology management, he always ensured that we kept our 
distinctiveness as methodologists, ensuring that decisions 
we took made sense for our group. 

Even with all of M.P.’s accomplishments as a survey 
statistician, it was his character that I admired the most. His 
selfless compassion for others, no matter what their level of 
competence, was his greatest strength, in my opinion. I can 
recall one occasion when the two of us were interviewing a 
highly qualified candidate whom we brought to Ottawa 
from a fair distance away. However, after just a few 
minutes, it was clear that, in spite of this person’s qualify- 
cations, he was not suitable for a position in the Meth- 
odology Branch. Yet, M.P. managed to make the candidate 
feel comfortable, after having made a special trip to Ottawa 
for the interview, by discussing that which the candidate 
was most familiar with, even though M.P. also recognized 
that the candidate was unsuitable for the Branch. 

M.P. always praised others when their accomplishments 
were noteworthy. This is one of the many reasons why he 
was endeared by so many, and why so many will miss him. 
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Manager and Mentor 


Jack Gambino 


Statistics Canada 


Others have written of M.P. Singh’s important and varied 
contributions to the statistics profession and to Statistics 
Canada. I had the good fortune to work closely with M.P. 
for 17 years and got to know a side of him that only those 
who worked with him on a regular basis saw and 
appreciated. I saw M.P. in his role as editor of Survey 
Methodology, including his involvement in the day-to-day 
activities that led to each issue of the journal, in his role as 
manager, and in his role as supervisor and mentor. 

In the 1980s, when I first joined Statistics Canada, it was 
impossible not to come across M.P. Singh. To me, for the 
first few years, he was the person who asked probing 
questions at each and every methodology seminar | 
attended. Much later, when we happened to sit on some of 
the same committees, I was always amazed when, during 
meetings, he would come up with good questions on topics 
that were clearly not on methodology turf. Invariably, his 
questions helped to clarify the issues, not only for 
methodologists, but for everyone in attendance. The lesson I 
learned from this was not to assume that I’m the only one 
who doesn’t fully understand the topic under discussion. 

MP. the Editor: | first got to know M.P. personally when 
I joined his subdivision in 1988. He immediately recruited 
me as an assistant editor of Survey Methodology. This was 
standard practice for M.P. —when people with a strong 
technical background came into his sights, they became 
potential assistant editors for the journal. Those of us lucky 
enough to become assistant editors learned a great deal from 
the experience. As M.P. grew to trust our judgment over 
time, he relied increasingly on our views, for example, in 
dealing with a paper that had received conflicting referee 
reports. 

MP. the Manager: M.P.’s approach to assistant editors is 
illustrative of how he managed more generally. He let 
people prove themselves and, with rare exceptions, each 
employee’s abilities grew in parallel with M.P.’s confidence 
in him or her. Many managers follow a specific manage- 
ment philosophy, sometimes jumping on whatever the latest 
management fad is. M.P. was not in that category. He was 
an intuitive manager and had a knack for spotting future 
“talent” early in their careers. He was also a non-authori- 
tarian manager who encouraged his staff in their work. 
Although M.P. was an open, easygoing manager, he knew 
when to put his foot down, as many of us who worked with 
him found out the hard way, albeit on rare occasions. 

M.P. was a strategic thinker who liked to discuss both 
statistical and management issues thoroughly. This 
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sometimes led to long meetings where we were all expected 
to give our views. And just when we would think that an 
issue was settled, M.P. would throw in a new twist that got 
the discussion going again! The advantage of M.P.’s 
approach, of course, was that by the end of the meeting we 
all understood the ins and outs of the subject under 
discussion and almost always reached a consensus. 

Throughout his career, M.P. took a strong interest in the 
development of researchers and the research function at 
Statistics Canada. He viewed an active research program as 
essential for the continued success of Statistics Canada. As a 
result, he worked to increase the professional visibility of 
researchers, and more generally of survey methodologists, 
within the Statistical Society of Canada and other 
organizations. 

M.-P. the supervisor and mentor: After working in M.P.’s 
area for a few years, I had the good fortune to report directly 
to him. Separating M.P. the supervisor from M.P. the 
mentor is impossible. He took a keen interest in his 
immediate employees’ careers, giving them advice and 
steering them toward the right choices or, more importantly, 
steering them away from the wrong ones. What was 
interesting was the way he often did this. Rather than be 
direct, he would often lead the employee, in a near-Socratic 
way, to the realization that something was not such a good 
idea. Another technique was the “look” — anyone who got to 
know M.P. well learned to tell at a glance when M_P. 
thought an idea was particularly bad. 

I learned a great deal about surveys from M.P. but more 
importantly, I think, I learned from him what makes a good 
manager, motivator and mentor. Thus I come to the 
realization that perhaps his greatest role was MP. the 
teacher. Those of us who worked closely with M.P. over the 
years will continue to benefit from his example for the rest 
of our careers, and I expect we will pass on what we learned 
from him, filtered through our own unique experiences, to 
the next generation as well. 


In his Own Words 


Eric Rancourt 
Statistics Canada 


M.P. was a man of impressive personality. Many of his 
employees and colleagues did not have the chance to work 
closely with him, but for those who did, M.P. would reveal 
himself as a very comprehensive and human character. 
Below are a few quotes from him that others and I have 
collected. These words usually came to us at a comforting 
time and always made us come out of his office on a 
positive note. 
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Don’t bother setting up a meeting, my door is 
always open to discuss anything. 

It’s good to have a pet project. 

We don’t design surveys to calculate the variance. 
I’m sure it can be done. 

You're telling me that 2 out of 3 of your findings 
did not make it to the survey! Don’t complain; if as 
much as 10% of your ideas get implemented, 
you ll have a great career! 
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There is a sign by the highway that says 100 km/h; 
that doesn’t mean you have to go to 100 km/h. 
Don’t worry, there is still time. 

After all the efforts we make in designing surveys, 
what we remember and appreciate the most is not 
the methods or results; it is the people we worked 
with. 
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Targeted Random Walk Designs 


Steven K. Thompson ' 


Abstract 


Hidden human populations, the Internet, and other networked structures conceptualized mathematically as graphs are 
inherently hard to sample by conventional means, and the most effective study designs usually involve procedures that 
select the sample by adaptively following links from one node to another. Sample data obtained in such studies are generally 
not representative at face value of the larger population of interest. However, a number of design and model based methods 
are now available for effective inference from such samples. The design based methods have the advantage that they do not 
depend on an assumed population model, but do depend for their validity on the design being implemented in a controlled 
and known way, which can be difficult or impossible in practice. The model based methods allow greater flexibly in the 
design, but depend on modeling of the population using stochastic graph models and also depend on the design being 
ignorable or of known form so that it can be included in the likelihood or Bayes equations. For both the design and the 
model based methods, the weak point often is the lack of control in how the initial sample is obtained, from which link- 
tracing commences. The designs described in this paper offer a third way, in which the sample selection probabilities 
become step by step less dependent on the initial sample selection. A Markov chain “random walk” model idealizes the 
natural design tendencies of a link-tracing selection sequence through a graph. This paper introduces uniform and targeted 
walk designs in which the random walk is nudged at each step to produce a design with the desired stationary probabilities. 
A sample is thus obtained that in important respects is representative at face value of the larger population of interest, or that 
requires only simple weighting factors to make it so. 


Key Words: Adaptive sampling; Link-tracing designs; Markov chain Monte Carlo; Network sampling; Random walk; 
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Respondent-driven sampling; Sampling in graphs; Sampling hidden population. 


1. Introduction 


Populations with linkage or network structure are 
conceptualized as graphs, with the nodes of the graph 
representing the units of the population and the edges or arcs 
of the graph representing the relationships or links between 
the units in the population. A central problem of studies in 
graph settings is that for many of the populations of interest 
it is difficult or impossible to obtain samples using con- 
ventional designs, and the samples obtained may be at face 
value highly unrepresentative of the larger population of 
interest. In practice, often the only practical methods of 
obtaining the sample involve following links from sample 
nodes to add more nodes and links to the sample. For 
example, in studies of hidden human populations such as 
injection drug users, sex workers, and others at risk for 
HIV/AIDS or hepatitis C, social links are followed from 
initially identified respondents to add more research parti- 
cipants to the sample. Similarly, in investigations of the 
characteristics of the Internet, the usual procedure is to 
obtain a sample of web sites by following links from initial 
sites to other sites. 

Klovdahl (1989) used the term “random walk’ to describe 
a procedure for obtaining a sample from a hidden population 
by asking a respondent to identify several contacts, one of 
whom is selected at random to be the next respondent, with 
the pattern continuing for a number of steps. Heckathorn 


(1997) described methods of “respondent-driven sampling” 
using procedures of this type. The motivation for using 
designs like this in practice is to penetrate deeper into the 
hidden population to obtain respondents who are more 
“representative” of the population than the more conspicuous 
initial respondents may be. In studies of the Internet, the 
parallel idea is that of the “random surfer”, who selects a web 
page at random, clicks at random on one of the links on that 
page, thus moving to another page, and so on (Brin and Page 
1998). The random walk design can be conceptualized as a 
Markov chain (Heckathorn 1997, 2002, Henzinger, Heydon, 
Mitzenmacher and Najork 2000, Salganik and Heckathorn 
2004). In this paper some modifications of these Markov 
chain designs are described, with the object of obtaining 
stationary probabilities of equal or specified values in order 
to obtain simple estimates of characteristics of the population 
graph of interest. 

Approaches to inference from samples in a graph setting 
include design-based, model-based, and combination 
methods. In the design based approach, all values of node 
and link variables in the graph are considered fixed or given, 
and inference is based on the design-induced probabilities 
involved in selecting the sample. In the model based 
approach, the population is itself viewed as a realization of a 
stochastic graph model, which provides the joint probability 
distribution of all the node and link variables. Previous 
design-based approaches include the methods of network or 
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multiplicity sampling (Birnbaum and Sirken 1965), adaptive 
cluster sampling applied in a graph setting (Thompson and 
Collins 2002), and a few of the methods in the snowball 
sampling literature (Frank 1977, 1978, Frank and Snijders 
1994). A method combining design and model based 
approaches is used in Felix-Medina and Thompson (2004) 
for studying a hidden population in which link-tracing 
follows from a probability survey sample from a frame that 
covers only part of the population. 

The advantage of design-based methods is that popu- 
lations such as socially networked hidden human popu- 
lations are difficult to model realistically, and the design- 
based inference does not rely on modeling assumptions for 
properties such as unbiasedness and consistency of esti- 
mators. Design-based inference methods do rely on the 
design being implemented according to plan, however, and 
exact implementation of a given design may be a very great 
challenge in studies of hidden human populations. This was 
the motivation for the development of a range of model- 
based methods for inference from samples in graphs, 
including maximum likelihood and Bayes techniques 
(Thompson and Frank 2000, Chow and Thompson 2003). 
Assuming that the initial sample is “ignorable” in the 
likelihood sense (Rubin 1976), or that the design is of 
known form so that it can be included in the likelihood and 
Bayes equations, these methods work for a very wide range 
of link-tracing sampling procedures, including most 
variations of the snowball and network methods. In reality, 
however, the initial sample may be selected in a fashion that 
is anything but ignorable, with selection probabilities 
depending on node value, node degree, and other factors. 
The pervasive problem of initial sample selection in link- 
tracing studies has been remarked upon by Spreen (1992) 
among others. 

The approach pursued in the present paper does not 
assume total control over all design possibilities, but rather 
seeks to work with the way samples naturally tend to get 
selected in networked populations, whether by ethno- 
graphers or other social scientists, members of the popu- 
lation themselves, or automated web crawlers. Starting with 
those natural selection processes, we introduce iterative 
modifications to obtain sampling procedures that step by 
step approach desired selection probabilities. 

Although the underlying structure of the designs in this 
paper depends on Markov chains, the estimators and 
quantities of most interest to investigators may not in fact be 
Markovian. For example, while the sequence of selections 
of sample units may depend at each step only on the most 
recently selected unit, the sequence by which distinct units 
are added to the sample depends on all units selected thus 
far. For this reason, the properties of a number of alternative 
estimators with different designs are examined using 
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simulation, by repeatedly selecting samples from stochastic 
graph realizations and from an empirical population from a 
study of a people at high risk for HIV/AIDS transmission. 

Random walk designs are described in section 2. 
Uniform and targeted walk designs are introduced in 
sections 3 and 4 respectively. Examples are worked in 
section 5, including an illustrative example using as the 
population a realization of a stochastic graph model and an 
empirical example using data from a study of a population 
at high risk for HIV/AIDS. 


2. Random Walk 


The population of interest is a graph, given by a set of NV 
nodes with labels U=({1,2,...,N} and values y= 
{V,5-++. Vy} and an NxN matrix A indicating relation- 
ships or links between nodes. An element a,, of A is one if 
there is a link from node i to node j and zero otherwise. The 
diagonal elements a,, are assumed to be zero. For node i, 
the row sum a,, is the out-degree or number of nodes to 
which 7 has a link and the column sum a,, is the in-degree 
or number of nodes which link to 7. With an undirected 
graph, the matrix A is symmetric and the in-degree of any 
node equals its out-degree. 

Let W, denote the unit or node of the graph that is 
selected at the k'" wave. If i is the node selected at the k" 
wave, then for wave k +1 one of the nodes linked from 7 is 
selected at random. Thus, {W,,W,,W,,...} 1s a Markov 
chain with 


PW = I |W, =i) = a; 1 a,,. (1) 


Let Q denote the transition matrix of the chain with 
elements q,, = P(W,,, = j|W, =i). The chain is a random 
walk in that at each step, one of the neighboring states of the 
present state is selected at random. 

If the graph consists of a single connected component, 
that is, if every node of the graph is reachable from every 
other node by some path, then the chain is irreducible and its 
stationary probabilities (7,,...,%,) satisfy 1, =) 7,9; 
for j=1,...,N. In fact, with the simple random walk 
design in a connected undirected graph the stationary 
probabilities can be shown (Salganik and Heckathorn 2004) 
to be 


. ‘ 
T, ©A,,. 


That is, for an undirected graph consisting of only one 
connected component, the long term selection frequency for 
any node is proportional to its in-degree, which, for a 
nondirected graph, equals the out-degree. 

Suppose one wishes to estimate a characteristic of the 
population graph, such as the population mean of the node 
values p, =>), y,/N using data from a random walk 
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sample. The sample mean y= ),., y, is in general not 
unbiased because the value y, of a node may be related to 
its degree and hence to its probability of being selected. 
However, one can obtain an approximately unbiased 
estimate by weighting each sample y—value by the 
reciprocal of its in-degree, assuming that that information is 
available from the data (Salganik and Heckathorn 2004). 


2.1 Random Walk with Random Jumps 


In a graph with separate components or with un- 
connected nodes, the simple random walk just described 
does not have the property that every node can be eventually 
reached from every other node. Without this property, the 
limiting distribution of the random walk is sensitive to the 
starting distribution, since the limiting probability for a node 
depends on the initial probability of starting in the 
component that contains that node. A modification of the 
design which overcomes this problem allows for a jump 
with small probability to a node at random from the whole 
graph. At each step, this random walk follows a randomly 
selected link with probability d and, with probability 1-—d, 
jumps to another node in the graph at random or with 
specified probability. In the Internet search literature, d is 
referred to as the “damping factor’, since a value of d less 
than one damps the effect of the out-degree of a given node 
(Brin and Page 1998). 

The transition probabilities for the random walk with 
jumps are given by 


mse seat if G0 
fi 


2 
1/N if a, =0. @) 


With the small probability 1—d of a random jump at 
any step, the Markov chain walk can potentially reach any 
node in the graph from any other, so that the chain is 
irreducible. Further, the random jumps, which include the 
possibility of going to node i from node i, ensure that the 
chain is aperiodic so that the stationary probabilities are 
limiting probabilities. With d <1 the stationary probability 
of node 7 is not a simple function of its own in-degree, but 
depends also on the stationary probabilities of the nodes that 
link to it. 

More generally, the jumps can be made with any 
specified probabilities p =(p,,..., Py) and the probability 
of a jump can depend on the current state, so that the 
transition probabilities are 


= (l-d,)p, + dja, /a,, if 
yee) ape if 


a;,, >0 


a,, = 0. 


Estimates which are approximately design-unbiased for 
population graph characteristics can be obtained by 
weighting sample values inversely proportional to the 
limiting Markov chain selection probabilities, but with the 
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additional problem that these limiting probabilities are 
unknown and must be estimated from the sample data (see 
Henzinger ef al. 2000 for an approach to this). 

For the remainder of this paper, “random walk” or 
“ordinary random walk” will refer to the random walk with 
jumps unless it is specifically stated to be a random walk 
without the option of jumps. 


3. Uniform Walk 


In this section a modification of the random walk design 
is proposed which leads to uniform stationary probabilities 
Me Teo ih 

Consider first the case of the population graph consisting 
of only one connected component. Let Q be the transition 
matrix for the simple random walk with transition proba- 
bilities q,, given by (1). Suppose that at step / the state of 
the process is i. A tentative selection is made using the 
transition probabilities in the i row of Q. Suppose that the 
tentative selection is node j. If the out-degree a,, of node j 
is less than the out-degree a,, of node i, then the selection 
for the next wave is node /, that is, W,,, = 7. If on the other 
hand, the out degree of node / is greater than the out degree 
of node i, then a uniform random number Z is selected from 
the unit interval. If Z<a,,/a,,, then W,,, = j. Otherwise, 
Wrest =i. 

Using the Hastings-Metropolis method (Hastings 1970), 
the transition matrix for the modified walk in the connected 
graph is constructed with elements 

Py = 90, for ie 
and 


P,=1-)) i 


j#i 


Mle 
Qa. =min,—~,1>. 
Ul] 
a, 


With a population graph containing separate components 
or isolated nodes, the random walk with jumps, having 
transition matrix Q given by (2), can be modified to give 


where 


P, = qj fore J 


and 


Ppaas )) P,, 


J#i 


| Wii 
SF eg Se a bg 
4ij 
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Thus, for two mutually connected nodes i and /, the 
acceptance probability for a transition from i to is 


_ ((l-d)/N+d/a,, 
OSS ee — ee 
V (l-d)/N+d/a,, 


For a transition from an isolated unit to one in a 
component larger than one node, the acceptance probability 
is o,, =1—d. Other acceptance probabilities have a, =1. 
Note also that for a directed graph, the acceptance 
probability for following an asymmetric link would be zero. 

The uniform walk is implemented, when the current state 
is i, by selecting a candidate next state, say j, using the 
transition probabilities in the i™ row of Q. A standard 
uniform random number Z is selected and, if Z < a, the 
next state is 7, whereas otherwise the walk stays at i for one 
more step. 

The quantity o,, with the uniform walk designs depends 
on the known transition probabilities of the basic random 
walk, so does not require estimation for implementation. 


4. Targeted Walk 


The same approach can be used to construct a walk 
having any specified stationary probabilities, for example 
selecting nodes with high y values with higher probabilities 
or selecting nodes to have probabilities strictly proportional 
to degree, even when the graph contains separate connected 
components. Let 2,(y) denote the desired stationary 
selection probability for the i node as a function of its y 
value. For example, in a study of a hidden human popu- 
lation at risk for HIV/AIDS, suppose it is desired to sample 
injection drug users (y,=1) with twice the probability of 
noninjectors (y, =0). The relevant transition probabilities 
for the value-targeted walk, using again the Hastings- 
Metropolis method, are 

Py = jy forme Fah 
and 


Py ly P 


Jal 


on WEBB 
a, =miny——, 1p. 
dij 


Note that the basic transition probability is known, since 
it depends only on out-degree of observed nodes, the chosen 
probability d, and the specified ratio 1, / 7. 

For a walk in which the relative selection probability 
depends on y value, the ratio 1 ,(y,)/m(y;) is specified and 


u.(y;)q.. 
(V5 )4ij 
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As another example of a targeted walk, the target 
distribution could be to have nodes selected proportional to 
their out-degree, that is, the number of links out. Since the 
degree for an isolated node is zero, one possibility, referred 
to as the “degree + 1” targeted walk, simply adds one to 
each degree, so that m,<a,,+1 is the target selection 
probability. 

A slightly different choice, referred to simply as the 
degree-targeted walk, adds one only to the degree of 
isolated nodes, so that m, < max(a,,,1). For a degree- 
targeted walk of this type, the acceptance probability for a 
transition between two mutually connected nodes is 


_[a,(1-d)/N +1 
o,°= mins 
j a,(1—d)/N +1 


For a transition between an isolated node and one with 
positive degree, the probability is 
a, =min(a,,(1—d),1). 


The transition probability between two nodes each 
having positive degree is 


. aj. 
a, =min{—.,]>. 
Y 
q;. 


mee 
o,, = min Be. 
4.4; 


Since isolated nodes, without any links to other nodes, have 
degree zero, to give them a positive selection probability 
their degree can arbitrarily be assigned the value “1” in the 
degree-targeted walk calculation, or the value 1 can be 
added to the degree of every node. 


In that case 


5. Nonreplacement Walk Designs 


The limiting distribution results of the previous sections 
apply exactly to walk designs with replacements, so that the 
selection of nodes can proceed indefinitely through the finite 
population. Some of the estimators used in the examples to 
follow, are based however on the sequence of distinct units 
selected through that process. The sequence of distinct units, 
which in effect provides a walk sample without replace- 
ment, can add new units only until the number of distinct 
nodes in the sample equals that of the finite population, at 
which point the sample mean and the population mean 
coincide. 

A different procedure for selecting a walk sample 
without replacement is to directly confine the selection of 
the next unit at any step from the set of units not already 
selected, as with the “‘self-avoiding random walk” (Lovasz 
1993). If a select-reject procedure is used as with the 
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targeted walks, the next selection is made from the set of 
units not having been tentatively selected at all, whether or 
not the unit was accepted. 


6. Estimators Based on the Values of the 
Accepted Nodes 


With a uniform random walk with replacement the draw- 
by-draw sample mean of the sequence of accepted values is 
asymptotically unbiased for the mean of the population, 
because the limiting selection probabilities are all equal. The 
draw-by-draw sample mean is the nominal mean including 
repeat values, so a node’s value is weighted by the number 
of times it is selected. With a without-replacement design 
this same estimator is not precisely asymptotically unbiased 
because the limiting probabilities are not exactly equal. The 
standard variance estimator based on a within-walk sample 
variance is not unbiased because of the dependencies within 
walks. Variance estimators are examined empirically in the 
examples. 

With a targeted walk in which the limiting probability 1, 
of node i is proportional to c,;, an asymptotically consistent 
estimator, based on the limiting probabilities, is provided by 
the generalized ratio estimator 


—— ey: 
- eae 


Note that the Horvitz-Thompson estimator can not be used 
because the proportionality constant in the inclusion proba- 
bilities is unknown, whereas in the generalized ratio 
estimator it cancels out. Again the limiting probabilities on 
which the estimator is based hold exactly for the with- 
replacement design. For the without-replacement variation, 
the estimator is examined empirically in the examples. 


7. Examples 


7.1 Realized Stochastic Graph 


Figure 1 depicts first a small simulated population having 
60 nodes. Nodes having value y=1 are colored dark and 
nodes with value y=O0 are light. The entire realization is 
taken to be our population of interest. The model producing 
the realization is a stochastic block model in which the 
probability of a link between any two nodes depends on the 
values of the nodes. Links are more likely between nodes of 
the same type, and the dark nodes are more highly 
connected than the light nodes. For example, it may be of 
interest to estimate the proportion of positive nodes (that is, 
nodes with y=1) in the graph. In the population graph, 24 


45 


of the 60 nodes are positive, so the true proportion is 0.4. To 
the right is shown the same graph but with node sizes 
proportional to the random walk limiting selection proba- 
bilities. Because of the higher linkage tendencies of the 
positive nodes, many of them have higher than average 
selection probabilities. 

In the bottom row of Figure 1 a random walk and a 
uniform walk selected from the population are shown. Each 
starts from the same randomly selected node, labelled “1’’, 
and proceeds until five distinct nodes are selected. The 
arrows show the direction of following links and a jump to a 
new node selected at random from the graph is shown as a 
dotted line. Note that the random walk backtracks from the 
third selected node to the second one before following a 
new link to the fourth sample node. From the first sample 
node, the uniform walk passes up the higher-probability 
node selected by the random walk, accepting instead 
another of the nodes linked to it. Either of these walks can at 
any time take a random jump, though in the examples 
illustrated only the uniform walk happens to take one, in the 
transition from the third to the fourth sample node. 


7.2 Empirical Population 


Data from a study on the heterosexual transmission of 
HIV/AIDS in a high-risk population in Colorado Springs 
(Potterat et al. 1993, Rothenberg et al. 1995) are shown in 
Figures 2 and 3. The 595 people interviewed in the study 
population are represented by the nodes of the graph, and 
the reported sexual relationships between the respondents 
are shown as links between nodes. (Additional sexual links 
from any of the 595 to persons who were not subsequently 
interviewed are not shown.) The study population includes 
at-risk people including injecting drug users, sex workers, 
their sexual and drug-use partners and other close social 
contacts. The node variable depicted indicates sex work, 
with a positive value (y=1) colored dark. Only sexual 
links are shown, though many coincide with the drug- 
related links. The largest sexually connected component of 
the graph contains 219 of the people. The next largest 
connected component contains 12 people, followed by a 
number of components of four, three and two people. The 
remaining nodes represent people without reported sexual 
contacts within the interviewed population. 

The observed pattern of this population, with one 
connected component very much larger than the others, has 
been described by researchers as not atypical of studies of 
hidden, at-risk populations. We are using this population 
solely as an empirical population from which to select 
samples to compare sampling designs and estimators. 
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Figure 1. 
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Limit selection probabilities 
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Top left: Population is realization of stochastic block graph model. Top right: The random walk limit 


probabilities of the nodes. Bottom left: Random walk of 5 steps. Bottom right: Uniform walk of 5 steps. 
Arbitrary axes scales are provided as a visual aid in identifying sample nodes with population nodes. 


Figure 3 shows the same population with node size 
drawn proportional to random walk limiting selection 
probability. 

Each plot of Figure 4 shows a cumulative sample mean 
of a single walk which is continued until 120 distinct nodes 
have been selected. The actual proportion of positive (1- 
valued) nodes in the empirical population (0.2235) is shown 
by the horizontal line in each plot. 

In the top row of Figure 4, an ordinary random walk with 
a randomly selected starting node is shown. The left plot 
shows the cumulative sample mean of the distinct units. The 
right plot shows the same data but with the draw-by-draw 
sample mean, which includes repeat selections of the same 
node, so that each node value is weighted by the number of 
times that node was selected during the random walk. 
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In the bottom row of Figure 4 the same two types of 
sample mean are shown for a uniform walk that is continued 
until 120 distinct nodes are selected. Notice that, for the 
ordinary random walk, the sample mean wanders mainly 
above the actual mean, representing the positive bias 
resulting from the preferential selection of the more highly 
connected, high-risk people in the population. For the 
uniform walk, the sample mean wanders closer to the actual 
value, sometimes above and sometimes below. Each of 
these plots also gives indication of the autocorrelation 
present within a single Markov chain. 
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Population 


Figure 2. 


High-risk population in Colorado Springs study on 
the heterosexual transmission of HIV/AIDS 
(Potterat et al. 1993, Rothenberg et al. 1995, and 
personal communications). Dark circles represent 
highest-risk individuals, in this case those who 
have exchanged sex for money. Links shown 
between individuals are sexual and drug injecting 
partnerships. 
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Sample mean of distinct units, uniform walk 
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Limiting random walk selection probabilities 
for Colorado Springs population. Notice that in 
the real population many of the individuals 
with the highest-risk behavior also have high 
selection probabilities with the ordinary 
random walk, and so will tend to be 
overrepresented in a sample. 
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Figure 4. Sample paths of sample means for a single random walk of length 120 nodes. The top two 
plots are with an ordinary random walk, while the bottom two are with a uniform walk. 
Sample mean of the distinct units, up to the wave given by the x-axis, is plotted on the left. 
On the right is the sample mean of the nominal draws, so that node value is weighted by the 


number of times the node is selected. 
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The plots in Figure 5 show the expected node value as a 
walk progresses wave by wave, for different types of walks 
and with different initial distributions from which the first 
node is selected, for the empirical population with 595 
nodes. Thus, for the k'" wave, the plots show E(Y,), where 
Y, is the value of the node selected at the k'" wave. The 
dashed line shows the actual mean for the Colorado Springs 
population (0.2235). The other three lines represent three 
different starting distributions. In all cases, the line that 
starts out the lowest is the uniform initial distribution, since 
the mean for the initial randomly selected node equals the 
mean for the population. The value-dependent initial distri- 
bution, in which positive nodes (y=1) have twice the 
initial selection probability of zero nodes ( y = 0 ), gives the 
expected value line that is in all cases mostly in the middle 
initially and shows the strongest tendency toward initial 
periodicity. The degree-based initial distribution, in which 
initial probability of selection for a node is proportional to 
its degree (plus one, since isolated nodes have zero degree), 
forms the top line in each of the plots. 

The six plots in Figure 5 show the expected values for six 
different types of walks. For a random walk that follows 
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links only, without the possibility of random jumps, the long 
term distribution is dependent on which component the 
walk starts in, which depends on the initial distribution. The 
three separate lines in the first figure reflect the sensitivity to 
the initial distribution. The random walk with jumps, on the 
other hand, enables any node to be reached from any other 
so that a limiting distribution is approached quite rapidly 
whatever the initial distribution. With the uniform random 
walk, the walk that starts with the uniform distribution stays 
in the uniform distribution wave after wave, and the walks 
that start with either of the unequal distributions depicted 
approach this distribution fairly rapidly. Each of the value- 
dependent and degree-dependent walks also approaches its 
limiting distribution fairly rapidly, with the expected node 
value considerably higher than the average node value in the 
population. The “degree + 1” walk approaches a distribution 
with selection probabilities proportional to one plus the 
degree for each node, while the “degree” walk has limiting 
probabilities proportional to the actual degree except that 
isolated nodes are assigned degree one. 
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Expected value of node by wave for different walk designs with the Colorado Springs 


empirical population. Each plot shows one walk design. The dashed line is the actual 
mean. The other three lines show expected value for three different starting distributions. 
In each case the lower of the three lines starts with the uniform distribution, the middle 
line with the value 2/1 distribution, and the top line with the degree distribution. 
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Tables 1 and 2 show the calculated values of the 
expected value of y for the Colorado Springs study popu- 
lation for each type of walk, wave by wave, and with 
different starting distributions for the mode selections. 
Results for ordinary random walks are in Table | and for 
uniform walks are in Table 2. The expected values are 
shown for the initial selections, waves 1, 2, 3, 4, 5, 6, 8, 16, 
and 32, and for the limit as the number of waves approaches 
infinity. The three initial distributions, for the selection of 
the first node of a walk, are random, selection in which 
positive nodes have twice the probability of zero-valued 
nodes, and selection proportional to in-degree of each node 
plus one. Note that, with k independent walks of a given 
design, the expectations at wave j would apply to the sample 
mean of the k y—values at wave j from each of the walks. 


Table 1 
Random Walks: Expected Value of y for Waves 0, 1, 2, 3, 4, 5, 6, 
8, 16, 32, and Infinite. Wave 0 is the Initial Selection. Three Dif- 
ferent Initial Selection Probability Assumptions are Used: Initial 
Random Selection (1) =1/N for all Nodes), Nodes with Value 
y = 1 Have Twice the Selection Probability of Nodes with Value 
y=O0(t) « y+1), and Initial Selection Probability Proportional 
to in-Degree Plus One (1 « a, ; +1). The Actual Mean of the 
Node Values for this Population is 0.2235294 


wave 1) =l1/N Ny < yt! TM) Ka, +1 
0 0.2235294 0.3653846 0.3349894 
] 0.299877] 0.2752690 0.3560839 
2 0.3005446 0.3587093 0.3507451 
3 0.3273606 0.3082865 0.3570490 
4 0.3177081 0.3594697 0.3500041 
5 0.3320705 0.3179675 0.3528395 
6 0.3231213 0.3542086 0.3469835 
8 0.3256034 0.3490933 0.3440449 
16 0.3291087 0.3372548 0.3363884 
32 0.3302606 0.3313908 0.3315119 
00 0.3303787 0.3303787 0.3303787 
Table 2 


Uniform Walks: Expected Value of y for Waves 0, 1, 2, 3, 4, 5, 


6, 8, 16, 32, and Infinite, with Three Different 


Initial Selection Assumptions 


wave 1 =1/N Ty cyt! TM Ca; +1 
0 0.2235294 0.3653846 0.3349894 
l 0.2235294 0.2590239 0.2903 147 
zz 0.2235294 0.2741356 0.2877974 
3 0.2235294 0.2447258 0.2761270 
4 0.2235294 0.2511473 0.2707929 
5 0.2235294 0.2372440 0.2646280 
6 0.2235294 0.2420866 0.2600923 
8 0.2235294 0.2371714 0.2522952 
16 0.2235294 0.2285370 0.2352150 
32 0.2235294 0.2243635 0.2256228 
00 0.2235294 0.2235294 0.2235294 


For the ordinary random walks, starting with the initial 
sample, the observed value is unbiased for the population 
value only for the initial selection, and thereafter the bias 
rapidly rises to its limiting value of 0.3303787—0.223594. 


19 


With the initial samples biased toward the positive nodes, 
the bias changes less as the walk progresses. 

For the uniform walk, an initial random selection 
coincides with the stationary distribution, so that the walk 
continues to be unbiased wave after wave. With the initial 
selection in which positive nodes have twice the selection 
probability of zero-valued nodes, the bias is greatly reduced 
with each of the first few waves and the selected node 
values approach their unbiased limiting state. With the 
initial selection proportional to in-degree plus one, the bias 
requires a few more waves to become small. The rapid 
initial approach of the expected value toward the limiting 
value suggests that it may be desirable to have an initial 
“burn in” period which is not used in the estimation part. 
Even a very short burn in of one to three waves could 
substantially reduce the bias of estimators based on short 
walks. 

Figures 6-9 show the sampling distributions of sample 
means and weighted estimators for different walk designs 
with the Colorado Springs data set. Each histogram is based 
on 1,000 simulations of the sampling design applied to the 
empirical population. For the designs in Figures 6 and 7, 
each sample consists of 24 walks, each having length 5, that 
is, continuing until 5 distinct nodes are selected. Figure 5 
shows the distributions of sample means for random walks 
(top row) and uniform walks (bottom row). The distribution 
of the mean of the 24 sample means of 5 distinct units is 
given on the left. On the right, the mean of the 24 draw-by- 
draw means, incorporating repeat selections, is given. 

The actual proportion (0.2235) of the y values in the 
empirical population is indicated by the solid triangle, while 
the mean of the sampling distribution is indicated by the 
hollow triangle. The sample means for the random walks 
are biased upward, while the sample means for the uniform 
walk are nearly unbiased. Neither is precisely unbiased, 
because of the way the walk continues until a fixed number 
of distinct nodes is selected, instead of proceeding for a 
fixed number of waves. 

Figure 7 shows the distribution of the generalized ratio 
estimator for the targeted walks having stationary probabi- 
lities related to node value and to degree (node degree plus 
one). For comparison purposes, each of these walks was 
started in its own stationary distribution, in effect giving the 
distributions of the estimators after “burn in’. These 
estimators are not unbiased, since effective sample size is 
fixed, which affects the actual probabilities with with 
distinct nodes are selected in sequence, and because the 
denominator of the estimator is random, being the sum of 
the sample weights. 

Figures 8 and 9 show the distributions of the same 
estimators and designs as in Figures 6 and 7, but with each 
sample consisting on one long walk of 120 distinct nodes. 
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Figure 6. Distributions of sample means as estimators of the proportion of people who 
have exchanged sex for money in the empirical population of the Colorado 
Springs study, with random and uniform walks. Solid triangle is the actual 
proportion in the population. Hollow triangle is the mean of the distribution of 
the estimator. Note the overestimation with sample means for ordinary random 
walks. Random walks are at top, uniform walks at bottom. Design was 24 walks, 
each of length 5, with all 120 observations used in the estimator. The number of 
realizations for the simulation was 1,000. 
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Figure 7. Distributions of generalized ratio estimators of the proportion of people who 
have exchanged sex for money in the empirical population of the Colorado 
Springs study, with targeted walks. Solid triangle is the actual proportion in the 
population. Hollow triangle is the mean of the distribution of the estimator. Note 
the overestimation with sample means for ordinary random walks. Random 
walks are at top, uniform walks at bottom. Design was 24 walks, each of length 
5, with all 120 observations used in the estimator. The number of realizations for 
the simulation was 1,000. 
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Figure 8. 


Figure 9. 
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Distributions of sample means as estimators of the proportion of people who 
have exchanged sex for money in the empirical population of the Colorado 
Springs study, with random and uniform walks. Solid triangle is the actual 
proportion in the population. Hollow triangle is the mean of the distribution of 
the estimator. Note the overestimation with sample means for ordinary random 
walks. Random walks are at top, uniform walks at bottom. Design was a single 
walk of length 120. The number of realizations for the simulation was 1,000. 
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Distributions of generalized ratio estimators of the proportion of people who 
have exchanged sex for money in the empirical population of the Colorado 
Springs study, with targeted walks. Solid triangle is the actual proportion in the 
population. Hollow triangle is the mean of the distribution of the estimator. Note 
the overestimation with sample means for ordinary random walks. Random 
walks are at top, uniform walks at bottom. Design was a single walk of length 
120. The number of realizations for the simulation was 1,000. 
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Tables 3—6 summarize the expected values and mean 
square errors of the estimators with the various strategies, 
based on the 1,000 simulation runs with the Colorado 
Springs data set serving as the population. 

Tables 7 and 8 give the variance and the expected values 
of between-walk sample variances, where available, and of 
within-walk sample variances for the uniform walk designs. 


Table 3 
Means and Mean Square Errors for Sample Means of Distinct 
Units and Draw-by-Draw Means for Random Walks and Uniforms 
Walks. The Design Uses 24 Walks Each Continuing Until 5 
Distinct Nodes are Included 


design: random walk random walk uniform walk uniform walk 
estimator: Sample mean _ draw mean sample mean draw mean 
mean 0.3008000 0.2994872 0.2423000 0.2289125 
m.s.e. 0.007617465 0.007608868 0.002016378 0.001974826 


Table 4 
Means and Mean Square Errors for Weighted Means (Generalized 
Ratio Estimator), Using the Distinct Units in Each Walk or the 
Draw-by-Draw Selections for Value-Dependent Walks and 
Degree-Dependent Walks. The Design Uses 24 Walks Each 
Continuing Until 5 Distinct Nodes are Included 


design: value walk value walk degree walk degree walk 
estimator: distinct units draw by draw distinct units draw by draw 
mean 0.1805114 = 0.2144555 = -0.2235257 ~—0.1994530 
m.s.e. 0.002546968 0.001195507 0.001807981 0.004382568 


Table 5 
Means and Mean Square Errors for Sample Means of Distinct 
Units and Draw-by-Draw Means for Random Walks and Uniform 
Walks. The Design Uses One Walk Continuing Until 120 Distinct 
Nodes are Included 


design: random walk Random walk uniform walk uniform walk 


estimator: sample mean draw mean sample mean draw mean 
mean  0.3274083 OS825 71 0.2379333 0.2232534 


m.s.e. 0.012004961 0.014902382 0.001777285 0.002442825 


Table 6 
Means and Mean Square Errors for Weighted Means (Generalized 
Ratio Estimator), Using the Distinct Units in Each Walk or the 
Draw-by-Draw Selections for Value-Dependent Walks and 
Degree-Dependent Walks. The Design Uses One Walk Continuing 
Until 120 Distinct Nodes are Included 


design: value walk value walk degree walk degree walk 
estimator: distinct units draw by draw distinct units draw by draw 
mean 0.1652275 = 0.2254267 ~=— 02404622 ~=—_0..1835336 
m.s.e. 0.003952703 0.001578039 0.002115518 0.003951540 


Table 7 
Variance of Estimators and Expected Values of Between-Walk and 
Within-Walk Sample Variances for the Uniform Random Walk, 
for the Design with 24 Walks of 5 Distinct Nodes Each 


estimator: sample mean draw-by-draw mean 
variance of estimator: 0.001665709 0.001947796 


E (between-walk variance) 0.001584203 0.001919005 
E (average within-walk variances) 0.001515521 0.001231983 
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Table 8 
Variance of Estimators and Expected Values of Within-Walk 
Sample Variance for the Uniform Random Walk, for the Design 
with a Single Walk of 120 Distinct Nodes. (No Between-Walk 
Sample Variance is Available for this Design) 


estimator: sample mean draw-by-draw mean 
variance of estimator: 0.001571384 0.002445 194 


E (average within-walk variances) 0.001510515 0.001429126 


Table 9 
Acceptance Rates for the Uniform and Targeted Walks in the 
Empirical Population 


design: uniform walk value walk degree + 1 degree walk 


walk 
acceptance rate 0.62 0.60 0.85 0.88 


8. Acceptance Rates 


The principal advantages of the controlled Markov chain 
sampling designs, such as the uniform and targeted walks, 
are (1) they make the limiting selection probabilities known 
from the data so that they can be used in estimation; (2) the 
limiting probabilities are chosen, so that certain types of 
nodes or graph characteristics may be preferentially se- 
lected; (3) the estimates are design based and so certain of 
their key properties do not depend on assumptions, which 
might turn out to be incorrect, about the population graph 
itself; and (4) with increasing chain length, the expected 
values of estimates tend to move toward the corresponding 
graph quantities even when the initial selection distribution 
is different from the limiting one. Further, the uniform walk 
design produces a sample that, without weighting or 
analysis, is at face value “representative” in some respects 
of the larger population. 

An important practical concern with the uniform and 
targeted walks is the acceptance rate, that is, the average 
probability a tentatively selected node is accepted. Tenta- 
tively selected nodes that are rejected do not contribute to 
the simple estimators. For a population such as the Internet, 
in which tentative selections and accept/reject decisions can 
be automated and made quickly, the acceptance rate may 
not be critical. Sampling simply continues until a suitable 
number of nodes are accepted. For studies of hidden human 
populations, sample sizes tend to be small. Members of the 
population are difficult to find and interviews may be time 
consuming. In some studies, however, the decision to accept 
or reject, based on a tentatively selected person’s out degree, 
may be fairly quickly ascertained through a short screening 
interview. Even so, it is desirable to have a sampling 
method with as high an acceptance rate as possible. 
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The random walks have acceptance probability equal to 
one, but do not in general have known or controlled limiting 
probabilities. If one thinks of the underlying random walk as 
the natural, uncontrolled walk through a population, then a 
controlled walk having a limiting distribution close to the 
natural random walk of the population would be expected to 
have a higher acceptance rate than a controlled having a 
limiting distribution very different from the natural random 
walk. That is, a controlled walk with a stationary distri- 
bution not far from the underlying random walk distribution 
should require less modification through the rejection of 
tentatively selected nodes than one with stationary distri- 
bution far from the natural random walk tendencies. 

As mentioned earlier, the stationary probabilities for an 
ordinary random walk in a nondirected graph with a single 
component are proportional to the degrees of the nodes. 
When there is more than one connected component, the 
random jump innovation is necessary to ensure that every 
node is reachable and to produce a single stationary 
distribution not dependent on the starting distribution, and 
the limiting probabilities are influenced by, but not strictly 
proportional to, the node degrees. Even with the random 
jump innovation and the induced acceptance probabilities, 
the targeted walks producing stationary probabilities 
proportional to node degrees may be the closer than the 
other controlled walks under consideration to the natural 
random walk distribution. Indeed, in Figure 5 it is evident 
that, for the empirical population, the equilibrium distri- 
bution of the expected node value for the degree + 1 walk is 
closer to the equilibrium for the random walk with jumps 
than is any of the other controlled designs studied. 

For the empirical population from the HIV/AIDS hetero- 
sexual transmission study, the acceptance rates for the 
different designs are given in Table 9. For the uniform walk 
design, the acceptance rate was 62 percent. For the value 
walk, giving twice the limiting probability for the high risk 
as for the low risk people, the acceptance rate was 60 
percent. For the degree walk, in which the limiting proba- 
bility was proportional to the degree plus one, the accep- 
tance rate was 85 percent. For the degree walk with ond 
added only for the degree of the isolated nodes, the accep- 
tance rate was 88 percent. 


9. Discussion 


The uniform and target walk sampling designs serve to 
make the limiting selection probabilities known from the 
data so that they can be used in estimation. Further, the 
limiting probabilities are chosen, so that certain types of 
nodes or graph characteristics may be preferentially 
selected. Dependence on the initial selection, which may be 
uncontrolled, decreased step by step. 
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The estimators used in this paper with the uniform and 
targeted walk designs can be said to be design based. Even 
though the exact design based selection probabilities may be 
unknown if they are unknown in the initial selection, the 
stationary selection probabilities are used in the estimators. 
With increasing chain length, these probabilities become 
more accurate and the expected values of estimates move 
toward the corresponding graph quantities. The design 
based estimation methods have the advantage that certain of 
their properties, such as design unbiasedness or consistency, 
do not depend on model based assumptions that would 
possibly be incorrect. The design based estimates have the 
additional attractive quality that they are very simple and 
easy to understand and explain, and can even produce data 
that can be presented without analysis or interpretation as 
representative in important characteristics of the wider 
population of interest. 

The use of Markov Chain Monte Carlo algorithms for 
data analysis with complicated models is common in 
statistics. The methods described here are unusual in that the 
Markov Chain methods are applied to real-world popu- 
lations to actually obtain the data, with the result that the 
data thus obtained can be easily analyzed by hand. In fact, 
one could go a step farther and construct a complex Bayes 
stochastic graph model for the population, using Markov 
Chain Monte Carlo methods in the conventional fashion in 
analyzing the data as well as in their collection. 

The uniform or targeted walk designs are useful to obtain 
samples of accepted nodes that have certain desirable 
properties in relation to the population, that provide very 
simple estimators of population quantities, or that could 
provide an initial sample for another design. It should be 
noted that nodes that were observed but then “rejected” 
under the design are actually still part of the data. Their 
values can still be incorporated into estimates if desired 
using the Rao-Blackwell method applied once the chain has 
reached approximate equilibrium, though the estimates then 
are computationally complex. 

Another alternative is to use model based methods such 
as Bayes estimates. The model based methods require, in 
addition to adequate stochastic graph modeling of the popu- 
lation, an ignorable initial selection procedure, which is not 
in general satisfied with initial selections biased by node or 
degree values, or else adequate modeling of the non- 
ignorable selection procedure as part of the likelihood. 
Targeted walk designs producing an asymptotic distribution 
unrelated to the nonignorable selection procedure and hence 
approximately unrelated to node or degree values outside of 
the sample could provide the initial selections for a sample 
with which model based inference methods could then be 
applied. 
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Using Missing Data Methods to Correct for Measurement Error in a 
Distribution Function 


Gabriele B. Durrant and Chris Skinner ' 


Abstract 


This paper considers the use of imputation and weighting to correct for measurement error in the estimation of a distribution 
function. The paper is motivated by the problem of estimating the distribution of hourly pay in the United Kingdom, using 
data from the Labour Force Survey. Errors in measurement lead to bias and the aim is to use auxiliary data, measured 
accurately for a subsample, to correct for this bias. Alternative point estimators are considered, based upon a variety of 
imputation and weighting approaches, including fractional imputation, nearest neighbour imputation, predictive mean 
matching and propensity score weighting. Properties of these point estimators are then compared both theoretically and by 
simulation. A fractional predictive mean matching imputation approach is advocated. It performs similarly to propensity 
score weighting, but displays slight advantages of robustness and efficiency. 


Key Words: Donor imputation; Fractional imputation; Hot deck imputation; Multiple imputation; Nearest neighbour 
imputation; Predictive mean matching; Propensity score weighting. 


1. Introduction 


Measurement error may lead to biased estimation of 
distribution functions (Fuller 1995). In this paper we consid- 
er approaches to correcting for this bias when, in addition to 
sample observations on the erroneously measured variable, 
values of the accurately measured variable are available for 
a subsample. When the subsample is selected using a 
randomised scheme, the set-up is an instance of the well- 
studied problem of double sampling (e.g., Tenenbein 1970). 
In this case, unbiased estimates can be constructed from the 
subsample alone, but use of data on the correlated surrogate 
variable for the whole sample may improve efficiency. See, 
for example, Luo, Stokes and Sager (1998). In this paper we 
shall suppose that the subsample is not selected by a known 
randomised scheme, but rather by an unknown missing data 
mechanism. We shall just assume that the accurate variable 
is missing at random (MAR) (Little and Rubin 2002), 
conditional on variables measured on the whole sample. 
Some inference methods are available for this problem if we 
are willing to make strong parametric assumptions about the 
true distribution (e.g., Buonaccorsi 1990) or about the 
measurement error model (e.g., Luo etal. 1998). We shall 
not consider such methods further, however, since we 
suppose that we are dealing with an application where such 
assumptions are unrealistic. Instead, the novel feature of this 
paper is to view inference in this measurement error set-up 
as a missing data problem and to consider the application of 
imputation and weighting methods from the missing data 
literature. Our focus will be on the choice of such methods 
to improve point estimation of the distribution function, 
in terms of bias, efficiency and robustness to model 


assumptions. We shall only consider variance estimation 
briefly. 

This paper is motivated by an application to the 
estimation of the distribution of hourly pay in the United 
Kingdom (UK), using data from the UK Labour Force 
Survey (LFS). In the LFS there are two ways of measuring 
hourly pay. The traditional method is to obtain information 
about earnings and hours worked and to derive a measure of 
hourly pay from this information. We refer to the variable 
derived in this way as the derived hourly pay variable. A 
more recent method of measuring hourly pay is to ask 
respondents directly about their hourly pay. We refer to the 
resulting measure of hourly pay as the direct variable. 
Skinner, Stuttard, Beissel-Durrant and Jenkins (2002) 
describe and provide empirical evidence of many sources of 
measurement error in the derived variable and conclude 
from their study that the direct variable measures hourly pay 
much more accurately than the derived variable. The 
problem with the direct variable is that it is missing for 
about 43% of all cases. The application is outlined in 
Section 8 and described in greater detail in Skinner et al. 
(2002), who also proposed the use of imputation to address 
the measurement error problem. This paper extends that 
work by considering a wider class of approaches to missing 
data and by comparing their properties both theoretically 
and via simulation. The imputation approach developed in 
this paper, which extends that considered by Skinner ef al. 
(2002), has now been implemented by the UK Office for 
National Statistics as a new approach to producing low pay 
estimates. 

The paper is structured as follows. The estimation 
problem is discussed in section 2. Imputation and weighting 
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approaches are set out in sections 3 and 4 respectively and 
their properties are studied and compared theoretically in 
section 5 and via a simulation study in section 7. Variance 
estimation is considered briefly in section 6. Section 8 
discusses the application of the methods to the LFS. Some 
concluding remarks are given in section 9. 


2. The Estimation Problem 


Let y, be the (true) value of a variable of interest 
associated with unit i in a finite population U. The 
distribution function of the variable in U 1s: 

F(y)=N" DI Sy), (1) 

icU 

where /(.) is the truth function (J(£)=1 if E is true and 
=0 otherwise) and y may take any specified value. 
Suppose that a survey is conducted on a sample s CU and 
that the variable is measured as y, for units ies. The 
difference between y, and y, represents measurement 
error. Suppose that the true value y, is recorded for a subset 
of sample units and that we write r,=1 if y, is recorded 
and 7 =0 otherwise. Let x, be a vector of auxiliary 
variables also recorded in the survey. Our data consist of 
values y,, x, and 7, for ies and values y, for ies 
when +7, =1. The problem is how to use these data to make 
inference about F'(y). 

In the LFS application, the units are employees, s is the 
set of unit respondents in the LFS sample, y, is the value of 
the derived hourly pay variable and y, is the value of the 
direct variable for employee i. The value y, is assumed 
equal to the true hourly pay. 

The primary feature of this inference problem that 
concerns us is the missingness of y, values and we consid- 
er two approaches to handle this missingness: 


— imputation of y, for units ies where r, =0, using 
the values y, and x, as auxiliary information; 


— weighting of an estimator based upon the responding 
subsample s, = {i€s; 7 =l}, in particular, the use 
of propensity score weighting (Little 1986). 


These approaches to estimating F'(y) will be discussed 
in the following two sections. 

Inference will be discussed under a model-based frame- 
work, in which it is assumed that the population values 
(V;,¥;,%X,,%),i€U, are independently and_ identically 
(IID) distributed and that sampling is ignorable, that is the 
distribution of (y,, y,,x,,7,) is the same whether or not 
ies. In section 8 we shall comment on how the methods 
developed under these assumptions may be adapted to 
handle the sampling design of the LFS and the use of 
weights to compensate for unit non-response in the survey. 
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3. Imputation Approaches 


Suppose initially that it is possible to observe y, for all 
ies. Then, under the assumptions given in the previous 
section, 


P(y)=2" 10, <9) (2) 


=I 


would be an unbiased estimator of Fy), in the sense that 
E[F(y)-F(y)]=0 for all y, where we write s= 
{1,...,7} and the expectation is with respect to the model, 
conditional on the selected sample s. To address the 
problem that y, is missing when 7, =0, suppose that y, is 
replaced in (2) by an imputed value y’ when 7, =0 (and 
ies) andlet y,=y, if 7=1 and y, = y; otherwise. The 
resulting estimator of F'(y) is 


F(y) =n" ¥ 1G, <y). 3) 


i=] 


A sufficient condition for F(y) to be an unbiased esti- 
mator of F(y) is that the conditional distribution of y, 
given r,=0, denoted f(y; |r, =0), is the same as the 
conditional distribution f(y, |7, =0). However, since y, 
is only observed when 7, =1, the data provide no direct 
information about f(y, |7=9) without further assump- 
tions. We consider two possible assumptions. 


Assumption (MAR): 7, and y, are conditionally inde- 
pendent given y, and x,. 


Assumption (Common Measurement Error Model): , 
and y, are conditionally independent given y, and x,. 


The first assumption is the standard one made when 
using imputation or weighting (Little and Rubin 2002) and 
is the one which we shall make. The second assumption is 
that the measurement error model, defined as the conditional 
distribution of y, given y, and x,, is the same for 
respondents (7, =1) and nonrespondents (7, = 0). We shall 
use the second assumption in the simulation study in section 
7 to assess robustness of MAR-based procedures. Inference 
under the second assumption is more difficult, however, and 
appears to require stronger modelling assumptions about the 
distribution of y, and x,; we are considering this problem 
in other research and do not pursue this further in this paper. 
The plausibility of these two assumptions for the LFS 
application is discussed further in Skinner ef a/. (2002). 

Under the MAR assumption we have /(y, | y, a 
N= 7 y.. x,,%=1) and a sufficient condition for 
F(Y) to estimate F(Y) unbiasedly is that 


FONE SO 1 Oe ee (4) 
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We therefore consider an imputation approach where the 
conditional distribution of y given y and x is ‘fitted’ to 
the respondent (7, = 1) data and then the imputed values _y/ 
are ‘drawn from’ this fitted distribution at the values y, and 
x, observed for the nonrespondents. Suppose that the 
conditional distribution f(y, | y;, x, 7, =1) may be repre- 


sented by a parametric regression model: 
g(¥,)=AG;» Je) 2. E(e,|y;, x,)=0 (5) 


where g(.) and A(.) are given functions and B is a vector 
of regression parameters. A point predictor of y,, given an 
estimator 8 of B based on respondent data, is 


el hipe |: (6) 


Using », for imputation may, however, lead to serious 
underestimation of F(y) for low values of y, since such 
simple regression imputation is expected to reduce the 
variation in Fy) artificially (Little and Rubin 2002, page 
64). This effect might be avoided by taking ye = 
Ee tha(y, xi B)+é], where é, is a randomly selected 
empirical residual (Little and Rubin 2002, page 65). Our 
experience is, however, that this approach fails to generate 
imputed values which reproduce the ‘spiky’ behaviour of 
hourly pay distributions in our application and may lead to 
bias around these spikes. We prefer therefore to restrict 
attention to donor imputation methods, which set y/ = Vai) 
(r,=0) for some donor respondent j=d(i) for which 
r, =1. The imputed value from a donor will always be a 
genuine value and will respect the spiky behaviour in our 
application. The basic donor imputation method we consid- 
er is predictive mean matching (Little 1988), that is nearest 
neighbour imputation with respect to y,, defined by (6), ie., 


impute y, by Vai 
satisfying |); — Dy) te 1y-Y; | (7) 


where 7, = 0 and 7, =1. 

Corollary 2 of Theorem | of Chen and Shao (2000) then 
provides theoretical justification for the approximate unbi- 
asedness of the resulting estimator F(y) for F(y), if the 
following four conditions hold: (1) y, is missing at random 
(MAR) conditional on z, = g '[h(y,,x,;B)], where B= 
plim(), (ii) the conditional expectation of y, given z; 1s 
monotonic and continuous in z,, (il) z,; and E()y,; |z;) 
have finite third moments and (iv) the probability of 
response given z is bounded above zero. These conditions 
seem plausible provided: the MAR assumption above holds; 
the distribution of y, only depends on y, and x, via 
z,; y, is areasonably good proxy for y,. In addition, Chen 
and Shao’s (2000) result needs to be adapted for the fact that 
the nearest neighbour is defined with respect to 68 whereas 
the above conditions are with respect to 8. This adaptation 
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seems plausible since, for a sufficiently large number of 
respondents, close neighbours with respect to j, = 
ehh bis B)] should also be close neighbours with 
respect to z, = 27 '[h (y,, x,; B)I: 

There are thus theoretical grounds that nearest neighbour 
imputation with respect to y, will lead to an approximately 
unbiased estimator of F'(y), subject to the MAR assump- 
tion and certain additional plausible conditions. It is also of 
interest to consider the efficiency of F'(y). The variance of 
F(y) for nearest neighbour imputation may be inflated if 
certain donors may be used much more frequently than 
others. We consider a number of approaches to reducing this 
variance inflation effect. 

First, we may restrict the number of times that respon- 
dents are used as donors by defining imputation classes by 
disjoint intervals of values of , and drawing donors for a 
recipient by simple random sampling from the class within 
which the recipient’s value y, falls. The smoothing will be 
greatest if we draw donors without replacement. We denote 
this hot deck method HDIWR or HDIWOR, depending on 
whether sampling is with or without replacement. A second 
approach is to undertake donor selection sequentially and to 
penalize the distance function employed for determining the 
nearest neighbour d(i) as follows 


| Vi — Yaciy | +ptaa)= | yi — J; |d+pz,)}, (8) 


where 1 € R* is a penalty factor, ¢, is the number of times 
the respondent j has already been used as a donor, 7, = 0 

and r,,,, =1 (Kalton 1983). A third approach is to employ 
repeated imputed values ye (™ > m=1,....M, for each 
recipient ies such that 7,=0. The resulting estimator of 
F(y) is MY, F”(y), the mean of the resulting esti- 
mators F“”(y). We refer to the third approach as fractional 
imputation (Kalton and Kish 1984; Fay 1996) rather than 
multiple imputation (Rubin 1996), since we do not require 
the imputation method to be ‘proper’, that is to fulfil 
conditions which ensure that the multiple imputation vari- 
ance estimator is consistent. We do not stipulate this re- 
quirement here because our primary objective is point esti- 
mation. In our use of fractional imputation we aim to select 
donors d(i,m), m=1,...,M, each a close neighbour to i, 
so that Fy) remains approximately unbiased for F'(y). 

We consider the following variations of this approach. 


(i) The M/2 nearest neighbours above and below 
y, are taken, for M =2 or 10, denoted NN2 and 
NN1O respectively. 

(ii) M/2 donors are selected by simple random 
sampling with replacement from the M 
respondents above and from the M respondents 
below y,, for M=2 or 10, denoted NN2(4) and 
NN10(20) respectively. 
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(iii) M =10 donors are selected by simple random 
sampling with or without replacement from the 
imputation classes referred to in the HDIWR and 
HDIWOR methods described above. We refer to 
these as the HDIWRI10O and HDIWORIO0 
methods. 


For comparison we also consider the Approximate 
Bayesian Bootstrap method of multiple imputation (Rubin 
and Schenker 1986), denoted ABB10, defined with respect 
to the imputation classes referred to in the HDIWR and 
HDIWOR methods. 


4. Weighted Estimation 


The estimator F(y) implied by the different imputation 
approaches considered in the previous section may be 
expressed in weighted form as: 


F(y) => wlQ,< y)/> Ws (9) 


i€Ss, iES, 


where s,={ies;7,=1} is the set of respondents and 
w, =1+d,/M, where d, is the total number of times that 
respondent i is used as a donor over the M repeated 
imputations. Note that >, w, =. Another choice of weight 
would be to set w, equal to the reciprocal of an estimated 
value of the propensity score, Pr(z, =1| Yak) (Little 
1986). This approach has been proposed for the hourly pay 
application by Dickens and Manning (2004). The propensity 
score might be estimated, for example, under a logistic 
regression model relating 7, to y, and x,. Under the MAR 
assumption, the resulting estimator Fy) will be approx- 
imately unbiased assuming validity of the model for the 
conditional distribution /(r,| y,,x,) and some regularity 
conditions, such as those described in section 3 for the 
imputed estimator. Note that the need to model f(y; | y 
x,) replaces the need to model f(y,|y,, x,) in the 
imputation approach. 


5. Properties of Imputation and 
Weighting Approaches 


In this section we investigate and compare the theoretical 
properties of the imputation and propensity score weighting 
approaches introduced in the previous two sections under 
various simplifying assumptions. We fix y and set uw, = 
I(y, < y). Letting N — oo we suppose that the parameter 
of interest is 9=E(u;). We consider the imputation 
approach first and suppose that y, depends upon y, and x, 
only via z,=g '[h(y,,x,;B] and that y, is missing at 
random given z,. Ignoring the difference between B and 
B, assuming s, 1s large, we consider nearest neighbour 
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imputation with respect to z,;. As in (9) the imputed 
estimator of 8 may be expressed as 


Os =v, / Dw (10) 
where w, =1+d,/M (and >, w, =n). We write the corre- 
sponding expression for propensity score weighting as 0. 
with w, replaced by wps;. Let Zps; be the scalar function 
of Vis x, upon which r, depends and write: 


Pr(r, =1| yj, x;) = U(Zps;)- (11) 


Just as we ignored the difference between B and B, we 
initially ignore error in estimating 1(Zpg;) and write 
Mes; = TU Zt) Ms 

The imputation and propensity score weighting ap- 
proaches may be expected to yield similar estimators if z, 
and Zp; are similar, that is they are close to deterministic 
functions of each other, and WM _ is large. To see this, 
consider a simple example of the imputation approach, 
where the donor is drawn randomly from an imputation 
class c of close neighbours with respect to z,, containing 
m, respondents and n, —m, nonrespondents, as described 
in section 3. In this case, w, will approach 1+(n, — 
m,)/m, =n,/m, aS M — and this is the inverse of the 
response rate within the class (David, Little, Samuhel and 
Triest 1983). More generally, with the fractional nearest 
neighbour imputation approach considered in section 3, the 
weight w,=1+d,/M may be interpreted as a local (with 
respect to z;) nonparametric estimate of Pr(7, ae yak ee 
despite the fact that imputation is based upon a model for 
y; given z, rather than 7, given z;. Thus, the imputation 
approach may be expected to lead to similar estimation 
results to propensity score weighting if z,; and Zp; are 
deterministic functions of each other. In general, however, 
this will not be the case. Since Pr(7,=1|z;) may be 
expressed as an average of Pr(7, =1| y,x) across values 
of y and x for which z=z,, we may interpret w, asa 
smoothed version of wp; and may expect it to show less 
dispersion. This suggests that it may be possible to use 
imputation to improve upon the efficiency of estimates 
based on propensity score weighting, as also discussed by 
David etal. (1983) and Rubin (1996, section 4.6). To 
investigate this further, assuming MAR and the other 
assumptions in sections 3 and 4 upon which the approaches 
are based, both imputation and weighting approaches lead to 
approximately unbiased estimation of F(y) and we may 
focus our comparison on relative efficiency. 

It follows from equation (3.3) of Chen and Shao (2000) 
that the variance of 0 wp may be approximated for large n 
by 


var (8 ip) = nE| >, wV (u, \z,) | +n'V[w(z,)], (12) 
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where y(z,;) = E(u; |z;) and any impact of estimating B is 
ignored. Note that Chen and Shao (2000) consider single 
imputation with M =1 but their proof of this result carries 
through if M >1. It is convenient to reexpress this result as 


var (8 ip) & 10° + OD (w? —w Vu, | z,)|, (13) 
using the identity 
Viw(z;)]=0° — E[V (u, |z,)I, (14) 


where o” = V(u,) and a corollary of Chen and Shao’s 
(2000) Theorem | that 


Bey WV (u, | z,) = EV, (z;))+0, (0) (15) 


Note that w? — w, =(d,/M)(1+d,/M) > 0. Expression 
(13) may be interpreted from both ‘missing data’ and 
‘measurement error’ perspectives. From a missing data 
perspective, the first term in (13) is just the variance of 6 in 
the absence of missing data and the second term represents 
the inflation of this variance due to imputation error. From a 
measurement error perspective, we may consider limiting 
properties under ‘small measurement error asymptotics’ 
(Chesher 1991), that is where y, —> y. and VF (ys 7.) 
approaches zero. In this case, the second term also ap- 
proaches zero and Op becomes ‘fully efficient’, ie., its 
variance approaches o” /n. 

Let us now consider propensity score weighting. We 
make the corresponding assumption that y, is missing at 
random given Zpc, . Linearising the ratio in (9), with wpe; in 
place of w,, using the fact that E(X, Wps;)=n and 
initially ignoring the impact of estimating the propensity 
score we may write 


var (Op) wn var| Woe Ai ae 6) 
ee E[Wps;(U; -6)"], (16) 
which may be expressed alternatively as 
vat (Ops) ~ Poe >. Wos,V (u; | Zesi) 
+n'E {Wes LW (Zps;) — ey} (17) 


To compare the efficiency of weighting and imputation it 
is convenient to use (14) and (15) (which hold also with 
Wps; In place of w,) to obtain 


var(0ps) NTO 
+n7E| >, (Weg; — Ws; )V (u; | Posy 


+n E{S [ps - MW @ps:)- OF}. (18) 
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Note that, in comparison with (13), this involves a third 
term, which does not necessarily converge to zero as y, 
approaches y, and V(u,|Zps;) > 0. Hence propensity 
score weighting does not become fully efficient as the 
measurement error disappears. The second term of (18) may 
also be expected to dominate the second term of (13) when 
V(u,|z;) and V(u,|Zp.;) are constant and equal, since, 
recalling that )}, w, = E(X, Wps;) =”, these second terms 
are primarily determined by the variances of the weights w, 
and Wpc,, and, provided M is sufficiently large, we may 
expect w, to display less variation than wp.,;, as argued 
above. 

The above discussion ignores the potential impact of esti- 
mating 8 or estimating a parameter vector a upon which 
the propensity score Pr(r, =1| y,, x,) may be assumed to 
depend. Kim (2004) shows in fact that the estimation of a 
by its maximum likelihood estimator @ reduces the 
variance of 0,. as follows: 


vat (0,.) © var (Opg) 


—cov (Op, @) var (4)! cov(4, 4,5), (19) 


where 6,. is the estimator 6,, with the estimated propen- 
sity scores replaced by their true values and where the left 
hand sides of (16), (17) and (18) should now be var (Onc) 
We conclude from this fact and the previous discussion that, 
in general, 0,,» is not necessarily more efficient than 6,. 
or vice versa and we look to the simulation study in section 
7 for numerical evidence. However, our conclusion that 
Lee is more efficient as measurement error disappears and 
y; — y, remains valid even in the presence of estimation 
error in a and £, since the impact of estimation error in B 
will disappear in this case with z, > y, whereas the 
second term in (19) when added to expression (18) will not 
in general reduce var (0,5) to o° /n in this case. 

Let us finally consider the impact of departures from 
the MAR assumption. Under small measurement error 
asymptotics where y, ey Sane y (Gs | 72) =>) “86 y > 
y,, the imputation approach will provide consistent 
inference about 6 even if the MAR assumption fails. This 
is not the case for the propensity score weighting approach. 
This suggests that the imputation approach may display 
more robustness to departures from the MAR assumption if 
the amount of measurement error is relatively small. 


6. Variance Estimation 


Although point estimation is the primary focus of this 
paper, we do now consider linearization variance estimation 
briefly. For propensity score weighting we refer to Kim 
(2004). For the single and fractional imputation methods in 
section 3 based upon nearest neighbour imputation, we may 
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consider a simplified approach based on the IID assumption 
set out in section 2 and the expression for the variance of 
Op in (13). 

The simple estimator of the first term o* /n: 


Sn tela WA dino tino (20) 


is approximately unbiased from Corollary 1 of Chen and 
Shao (2000). It follows that an approximately unbiased esti- 
mator of var(®;);p) iS 


VOnp)an @ +n > ww )V@,1z,) QD 


if we can construct an approximately unbiased estimator 
V(u, |z,) of V(u,|z;). Various approaches to estimating 
V(u,|z,) seem possible. Following Fay (1999), we might 
consider the sample variance of uw, values for responding 
neighbours near to i with respect to z. An alternative 
approach would be to consider a model-based approach in 
which a model is fitted to w(z,;)=E(u;|z;) for ies 
giving w(z,) and we set V(u, 12.) a (Zaye CZ) 
We have considered nonparametric methods of fitting 
w(z;), but have found with the LFS data that these lead to 
very similar values of V (6,,») as a logistic regression 
model for wy (z;). 

It may be possible to apply ideas in Chen and Shao 
(2001) or Kim and Fuller (2002) to extend the above 
approach to handle survey weights and a complex design. 
See Rancourt (1999) and Fay (1999) for other variance 
estimation approaches for nearest neighbour imputation and 
Little and Rubin (2002) for multiple imputation approaches. 


7. Simulation Study 


The aim of the study is to generate independent repeated 
SATADIES i is8 a) AP te Lesasehd , oo WAU VALUES Taal, Vis, 087", 
ies” which are realistic in relation to the LFS application, 
considered further in section 8, to compute the corre- 
sponding estimates F”(y) for alternative approaches to 
missing data and values of y and to assess the performance 
of the estimators F(y) empirically. In order to employ 
realistic values, the samples s“”’ of size n were drawn with 
replacement (i.e., using the bootstrap) from an actual sample 
of about 16,000 employees for the March-May 2000 
quarter of the LFS (only main jobs of employees aged 18+ 
were considered and the very small number of cases with 
missing values on y, or x, were omitted). The values of x, 
for each sample s‘”’ were taken directly from the values in 
the LFS sample. Variables were chosen for inclusion in x, 
if they were either related to hourly pay, measurement error 
in y, or response 7, (see Skinner ef al. 2002) and included 
for example age, gender, household position, qualifications, 
occupation, duration of employment, full-time/part-time, 
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industry and region (several of these variables were 
represented by dummy variables). We set n = 15,000, such 
that each s“) was of a similar size as the original LFS 
sample, and H =1,000. The values of y,, y; and r, for 
each sample s‘” were generated from models, rather than 
directly from the LFS data, for the following reasons. 


y,: these values were generated from a model because 
they were frequently missing in the LFS. A linear 
regression model was used, relating In(j,) to 
In( y, ) and x, with a normal error and with 20 
covariates including squared terms in In( ys ) and 
age and interactions between In( y, ) and 5 compo- 
nents of x,. The model was fitted to the roughly 
7,000 cases where y, was observed. 

y,: these values were generated from a model to avoid 
duplicate values of (y,,x,) within each s, 
which it was considered might lead to an un- 
realistic distribution of distances between units for 
the nearest neighbour method. The model was a 
linear regression model relating In(y, ) to x, with 
a normal error and with 12 covariates, including a 
squared term in age and one interaction, fitted to 
the LFS data. 

r,: these values were generated from a model to en- 
sure that the missing data mechanism was known. 
Several models were fitted. The only one reported 
here is a logistic regression relating 7, to In( Vn) 
and x, with 17 covariates including squared 
In( y,) and interactions between In a ) and two 
covariates. The model was fitted to the LFS data. 
The missing data mechanism is MAR given the y, 
and x, for all the results presented except those in 
Table 5. 


Estimates 0” of two parameters (t=1,2) were 
obtained for each sample s”, 


8,= proportion with pay below the national minimum 
wage (= £3.00 per hour aged 18-21, £3.60 per 
hour aged 22+) 

8,= proportion with pay between minimum wage and 
£5/hour. 


The true values are 8,=0.056 and 0, =0.185. The 
bias and standard error were estimated as bids(6,) = 0, — 0, 
and &.e.(6,) =[H'>#_(6 —6,)°]”, where 6, = 
He Spot 

For the fractional imputation methods several different 
values for M were explored and M=10 or 20 were 
chosen to achieve an increase in the efficiency whilst still 
being able to define a nearest neighbour imputation 
sensibly. 
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We first compare results for the alternative imputation 
approaches. Table | presents estimates of the biases of esti- 
mators of 8, and 8, for different imputation methods, for a 
MAR missing data mechanism. There is no evidence of 
significant biases for any of the nearest neighbour (NN) 
methods. The bias/standard error ratios are small and may 
be expected to be even smaller for estimates within domains 
e.g., regions or age groups. We conclude that there is no 
evidence of important bias for these methods, provided the 
MAR mechanism holds and the model is correctly 
specified. 

There is some evidence of statistically significant biases 
for each of the three methods based on imputation classes 
(HDIWR10, HDIWOR10, ABB10) perhaps because of the 
width of the classes, although the bias appears to be small 
relative to the standard error. Given the additional 
disadvantage of these methods, that the specification of the 
boundaries of the classes is arbitrary, these methods appear 
to be less attractive than the nearest neighbour methods. 
This finding contrasts with the preference sometimes 
expressed (e.g., Brick and Kalton 1996, page 227) for 
stochastic methods of imputation, such as the HDI methods, 
compared to deterministic methods, such as_ nearest 
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neighbour 
parameters. 

Corresponding estimates of standard errors are given in 
Table 2. We find as expected that the greatest standard error 
occurs for the single NN1 imputation method. The variance 
is reduced by around 10% using the penalty function 
method (NNIP). About 10-20% reduction arises from 
using two imputations (NN2 or NN2 (4)) and around 20% 
reduction from using ten imputations (NN10, NN10 (20)), 
HDIWR10, HDIWOR10, ABB10). For a given number of 
imputations (2 or 10) there seem to be no obvious 
systematic effects of using a stochastic method (NN2 (4) or 
NN10 (20)) versus a deterministic method (NN2 or NN10). 
We would expect the standard errors for HDIWR10 to be no 
less than HDIWOR1O, which is the case for 0, in table 2. 
The slight reduction for the standard error of estimator 6, is 
likely to be caused by a comparatively small number of 
simulation iterations (H =1,000), which may not be fully 
sufficient for standard error estimation. We conclude that 
NN1O is the most promising approach, avoiding the bias of 
the imputation class methods and having appreciable 
efficiency gains over the methods generating one or two 
imputations. 


imputation, when estimating distributional 


Table 1 
Simulation Estimates of Biases of Estimators of 8, and 8, for Different Imputation Methods, 
Assuming MAR and Correct Covariates (H = 1,000) 


Imputation Method Bias of 6, Rel. Bias of 6, Bias of 6, Rel. Bias of 6, 

NNI1 1.2*10° 0.2% 0.9*104 0.0% 
(0.9*107%) (1.7*10") 

NNIP! 4.4*107 0.8% 0.3*107 0.0% 
(2.6*10°) (5.1*107%) 

NN2 0.6*107* 0.1% 1.6*107 0.0% 
(0.8* 107) (1.5*107%) 

NN2(4) 1.4*1074 0.2% 22h i oll (0 -0.1% 
(0.9*10%) (1.5*107%) 

NN1O 0.2*107 0.0% —f2"10) = 0% 
(0.8*107) (1.5*107) 

NN10(20) 0.2*107 0.0% 0.7*107 0.0% 
(0.8*10%) (1.5*10%) 

HDIWR10 28°10 0.5% 26.2*107 1.4% 
(0.8*10%) (1.5*10%) 

HDIWOR10 ) SAO * 0.4% 28.0*107 1.5% 
(0.8*107) (1.5*10%) 

ABB10 4.6*107 0.8% 29.8*104 1.6% 
(0.8*107) (1.5*10%) 


Standard errors of bias estimates are below the estimates in parentheses. 
'Note: H =100 iterations were used due to computing time. 
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Table 2 
Simulation Estimates of Standard Errors of Estimators of 8, and 0, for Different Imputation Methods, 
Assuming MAR and Correct Covariates (H = 1,000) 


Imputation Method s.c.(0,) 

NNI 2.79* 10° 
NNIP? 2.60*10° 
NN2 2.68*10° 
NN2(4) 2.73*10° 
NNI1O 2.56*10° 
NN10(20) 2.57*10° 
HDIWR10 252710 
HDIWOR10 2.48*10° 
ABB10 2.63*10° 


=e = 
s.e.(85) Vin (9;) Vy (9>) 

5.43*10° l I 
5.15*10° 0.87 0.91 
5.05*10° 0.91 0.86 
4.88*10° 0.94 0.80 
4.88*10° 0.83 0.81 
4.79*10° 0.84 0.77 
4.66*10° 0.82 0.74 
4.72*10° 0.78 0.76 
4.87*10° 0.88 0.80 


* Note: H =100 iterations were used due to computing time. 


We next compare the NN10 imputation approach with 
propensity score weighting (PSW). We consider not only 
the case when the specification of the model used for 
imputation or weighting corresponds to the model used in 
the simulation, as in Table 1, but also some cases of 
misspecification. To ensure a fair comparison of weighting 
and imputation we use the same covariates when fitting both 
the models generating y, and 7. We first consider the 
estimated biases in Table 3. When the model for imputation 
(NN10) or the propensity scores is correctly specified 
neither method demonstrates any significant bias in the 
estimation of 0, or 9,. Significant bias does arise, 
however, in both cases if the model is misspecified by 
failing to include covariates used in the simulation. The 
amount of bias is, however, noticeably greater for the 
weighting approach. For example, for the estimator 0, the 
bias is 3—7 times higher under PSW than under NN10 
depending on the misspecification. The impact of the 
misspecification seems higher for estimator 6,, in 
particular for the PSW method. For this estimator, we found 
a 6—15 times higher bias for PSW than for NN10. 

Corresponding estimated standard errors of 6, and 6, 
are given in Table 4. These also tend to be greater for the 
weighting approach, showing an increase between 5 —15% 
in comparison to the imputation method. The increase in the 
standard error is higher for the second estimator 6,. 
ranging from 12-15%, whereas for estimator 6, the 
increase is between 5—12%, depending on the misspecifi- 
cation. Consequently, the mean squared error is also higher 
for the weighting approach, with the increase ranging from 
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20% to 28% for the six values in Table 4. At least under the 
MAR assumption, the NN10 imputation approach appears 
to be preferable to propensity score weighting in terms of 
bias and variance. 

Finally, we compare the properties of imputation (NN10) 
and propensity score weighting when the MAR assumption 
fails. We now simulate missingness according to the 
Common Measurement Error model assumption of section 
3. The same logistic model with the same coefficients as in 
the previous simulation is used except that y, is replaced as 
a covariate by y,. Simulation estimates of biases and 
standard errors are presented in Table 5. We observe a non- 
negligible significant relative bias of around 5% for the 
imputation approach and a little higher for the propensity 
score weighting approach. The positive direction of the bias 
of 6, is as expected from arguments in Dickens and 
Manning (2004) and Skinner efa/. (2002). MAR-based 
methods will tend to overestimate numbers of the low paid, 
if the CME assumption holds. This is because employees 
with observed y, values tend to be lower paid than 
employees with missing y, values and a MAR-based 
imputation method, even conditional on other variables, 
would tend to impute lower hourly pay values than would 
be the case under CME which allows for the dependency on 
true hourly pay. While the direction of the effect may be 
anticipated, the magnitude of the effect is of some 
importance for the robustness of MAR-based methods. The 
relative bias of 5% of the NN1O approach does not, 
however, appear to make the resulting estimates unusable. 
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Table 3 
Simulation Estimates of Biases of Estimators of 8, and 8, for Nearest Neighbour Imputation (NN10) and Propensity 
Score Weighting, Assuming MAR and Correct and Misspecified Covariates (H = 1,000) 


Method Assumed Covariates Bias of 0, Rel. Bias of 0, Bias of 0, Rel. Bias of 0, 
NN1O M1 (correct) —0.18*107 —0.03 % 588104 —0.31% 
(0.64* 10%) (1.20* 10%) 
M2 Sieg: B024% «4.74710. . -0.25% 
(0.65* 10%) (1.23*107) 
M3 = 1662105 a Oe NY 5 (0 pe RL 
(0.63*10") (1.23*10") 
Propensity Score Weighting M1 (correct) 0.15*107 0.03 % GO a 0). 14 oe 
(0.72*10~) (1.35*10") 
M2 —8.96* 107 -~1.64% 70.2*107 3.80 % 
(0.68* 107) (1.40*10%) 
M3 —5.02*107 ~0.92 % 67.8*107 3.66% 
(0.68* 107) (1.41*10%) 


Note: M1 is the correct model 


M2 excludes the interactions and the square terms from the correct model 


M3 drops further covariates from model M2. 


Table 4 


Simulation Estimates of Standard Errors of Estimators of 8, and 8, for Nearest Neighbour Imputation (NN10) 
and Propensity Score Weighting, Assuming MAR and Correct and Misspecified Covariates (H = 1,000) 


Method Assumed Covariates _s.e.(0,) s.e(8,) | MSE(6,) MSE(6;) 
NNI1O M1 (correct) 2.02*10° 3.80*10° 4.10*10°  1.49*10° 
M2 2.06*103.. 3.88710" .4.29*10°-, _ 1.54*10> 
M3 VME Mery GABOR OF aos AehO* 10cm Cl GGEL0° 
Propensity Score Weighting MI (correct) QO AT OGIO ear 10 
M2 217*10° 4.42*10° 5.51*10° _ 6.9010" 
M3 2.16*10° 4.46*10°  4.94*10°  — 6.59* 10° 


Table 5 
Simulation Estimates of Biases and Standard Errors of Estimators of 8, and 0, for Nearest Neighbour Imputation (NN10) 
and Propensity Score Weighting. Under the (non-MAR) Common Measurement Error Model (H = 1,000) 


Method Bias of 6, Rel. Bias of 0, Bias of 6, Rel. Bias of 6, s.e.(0;) s.e.(05) 

NN10 29.0*107* 5.1% 92.0*107* 5.0% 2.53*10° 4.70*10° 
(0.8*107) (1.48* 107) 

Propensity Score Weighting  32.3*10% 5.7% 100*107 5.7% 2.31*10° 4.42*10° 
(0.73* 10%) (1.40*10") 


8. Application to the Labour Force Survey hourly pay in the UK (Stuttard and Jenkins 2001). It is a 
quarterly survey of households selected from a national file 
of postal addresses with equal probabilities by stratified 
systematic sampling. All adults in selected households are 


included in the sample. The resulting sample is clustered by 


In this section we consider the application of the methods 
developed in sections 2—4 to LFS data. The LFS provides 
an important source of estimates of the distribution of 
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household membership but not by geography. Each selected 
household is retained in the sample for interview on five 
successive quarters and then rotated out and replaced. 
Questions relating to hourly pay are asked in just the first 
and fifth interviews, generating data on this topic for about 
16,000 employees per quarter. 

Two measures of hourly pay are constructed, as outlined 
in Section 1. The derived hourly pay variable in the LFS is 
defined as follows: (a) employees are asked questions about 
their main job to determine earnings over a reference period, 
(b) questions are asked to determine hours worked over the 
reference period and (c) the result of (a) is divided by the 
result of (b). The direct variable is obtained by first asking 
whether the respondent is paid a fixed hourly rate and then, 
if the answer is positive, by asking respondents what this 
(basic) rate is. Skinner et al. (2002) discuss how the derived 
variable suffers from many sources of measurement error, 
as in similar surveys in other countries (Rodgers, Brown and 
Duncan 1993; Moore, Stinson and Welniak 2000). They 
conclude that the direct variable measures hourly pay much 
more accurately. A working assumption in this application 
is that the direct variable measures hourly pay without error. 
The problem with the direct variable, however, is that it is 
missing for respondents who state that they are not paid at a 
fixed hourly rate (and for item nonrespondents) and this 
missingness is positively associated with hourly pay. The 
proportion of LFS respondents with a (main) job who 
provide a response to the direct question is about 43%. This 
proportion tends to be higher for lower paid employees, for 
example the rate is 72% among those in the bottom decile of 
the derived variable. The direct variable is not collected for 
second (and further) jobs and we therefore restrict attention 
only to main jobs. The aim is to use the missing data 
methods developed in this paper to correct for the 
measurement error in hourly pay. Skinner etal. (2002) 
discuss the plausibility of the two missing data assumptions 
in section 3 for this application. 

The methods in sections 2—4 were developed under the 
assumption of an IID model and ignorable sampling. 
Employees are selected with equal probabilities in the LFS 
so the sampling may be viewed as ignorable with respect to 
the bias of point estimation but unit non-response is likely to 
be differential and survey weights are constructed to com- 
pensate for this non-response (ONS 1999). We propose to 
incorporate these survey weights into the estimator in (3) or 
equivalently to multiply the weights w, in (9) by the survey 
weights. This is analogous to the way the pseudo-likelihood 
approach (Skinner 1989) weights estimators based upon an 
IID assumption. The aim is to use the methods of sections 
2—4 to compensate for bias due to measurement error and 
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item non-response and the survey weights to compensate for 
bias due to sampling and unit nonresponse. We have not 
attempted to take account of the weights in the imputation 
methods and this could be explored in future research. 

We now apply nearest neighbour imputation, hot deck 
imputation within classes and propensity score weighting to 
LFS data. All methods are weighted by the survey weights. 
Figure | compares an estimated distribution, which ignores 
measurement error (the bold line) with estimates based on 
three missing data methods (the three dotted lines). We 
suggest the latter estimates are more approximately unbi- 
ased than the former estimate. All three missing data adjust- 
ments show, as expected, a strong ‘kink’ in the distribution 
at the level of the national minimum wage unlike for the 
derived variable. Corresponding estimates of two low pay 
proportions of interest are presented in Table 6. The 
‘missing data adjustments’ have a substantial impact in 
comparison to estimates based on the derived variable. The 
results suggest that the proportion of jobs paid at or below 
the national minimum wage rate may be overestimated by 
four or five times if measurement error is ignored. The 
differences between the missing data methods are much 
smaller. We can see that the estimates under propensity 
score weighting differ from estimates derived using imputa- 
tion methods, at least for the June-August 1999 quarter. 
Note that this quarter of the LFS was subject to a lower 
response rate than subsequent quarters resulting from 
changes in the LFS questionnaire. It was found that for 
consecutive quarters, which are subject to about 43% 
response rate, weighting and imputation led to very similar 
estimates of low pay proportions, as illustrated in table 7 for 
the March—-May 2000 quarter. The decrease in the propor- 
tion of low paid employees over time is a result of the 
impact of the National Minimum Wage legislation. In 
addition, different imputation and propensity score models 
are used to analyse the effects of various model speci- 
fications on estimates of low pay. From Table 6 we can see 
that there is an indication that different models can have an 
effect on the estimates. With increasing complexity of the 
model a reduction in the estimates for both point estimators 
is observed. This might reflect a departure from the MAR 
assumption for the simpler imputation models. At least for 
the 1999 quarter, the differences in the estimates between 
weighting and imputation methods seem to be greater than 
between models. Note that the estimates presented here 
might differ slightly from official UK estimates since, for 
example, the official estimates are based on different 
imputation models, treating outliers differently or imputing 
differently for certain professions. 
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Figure 1. Alternative Estimates of the Distribution of Hourly Earnings 
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Wage 
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From £2 to £4 for Age Group 22+, June-August 1999. 


Table 6 


Estimates of 8, and 0, (Weighted) for 18+ Using Different Propensity Score Models and Imputation 


Method 


Derived Variable 
Propensity Score Weighting 


HDIWOR10 


NN1O 


Models Applied to LFS, June—August 1999 


Propensity Score Model or Imputation Model 


Ml 
M2 
M3 


Ml 
M2 
M3 


Ml 
M2 
M3 


Note: M1 is the most complex model including square terms and interactions 
M2 excludes the interactions and the square terms from model M1 
M3 drops further covariates from model M2. 


Table 7 


(Weighted) 
6, (%) 


JAE) 
0.96 
1.08 
1.08 


1.44 
1.41 
1.50 


952 
1.44 
1.50 


(Weighted) 


0, (%) 


Estimates of 8, and 8, (Weighted) for 18+ Using Propensity Score Weighting and Imputation 


Method 


Propensity Score Weighting 
HDIWOR10 
NN1O 


Applied to LFS, March—May 2000 


Propensity Score Model or (Weighted) 
Imputation Model 6, (%) 
M1 0.54 
M1 0.57 
M1 0.55 


pA) 
34.5 
38.4 
38.4 


Stk 
5259 
S32 


32.6 
32.8 
55.0 


(Weighted) 
8, (%) 


27.10 
26.01 
26.61 
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9. Conclusions 


In this paper we have considered the application of 


alternative missing data methods to correct for bias in the © 


estimation of a distribution function arising from measure- 
ment error. Among imputation methods, nearest neighbour 
methods have performed most promisingly in terms of bias. 
These deterministic methods display no evidence of greater 
bias than stochastic imputation methods. Fractional impu- 
tation has shown appreciable efficiency gains compared to 
single imputation and appears more effective than penal- 
izing the distance function or sampling without replacement 
with single imputation. In comparison to a propensity score 
weighting approach, the fractional nearest neighbour 
imputation has performed similarly, but has demonstrated 
slight advantages of robustness and efficiency. The simu- 
lation study suggested that the impact on the bias under a 
wrong model is greater for propensity score weighting and 
that the standard errors for the weighting approach were 
approximately 5—15% times higher than for the imputa- 
tion method. 

Further research is being undertaken to develop and 
evaluate associated variance estimation methods, as well as 
alternative point estimation methods based upon the 
Common Measurement Error Model in section 2. 
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On Calibration Estimation for Quantiles 


Torsten Harms and Pierre Duchesne ! 


Abstract 


In this paper, we consider the estimation of quantiles using the calibration paradigm. The proposed methodology relies on an 
approach similar to the one leading to the original calibration estimators of Deville and Sarndal (1992). An appealing 
property of the new methodology is that it is not necessary to know the values of the auxiliary variables for all units in the 
population. It suffices instead to know the corresponding quantiles for the auxiliary variables. When the quadratic metric is 
adopted, an analytic representation of the calibration weights is obtained. In this situation, the weights are similar to those 
leading to the generalized regression (GREG) estimator. Variance estimation and construction of confidence intervals are 
discussed. In a small simulation study, a calibration estimator is compared to other popular estimators for quantiles that also 


make use of auxiliary information. 


Key Words: Calibration estimators; Quantiles; Ratio estimators; Difference estimators. 


1. Introduction 


In recent years, considerable attention has been given to 
the estimation of population distribution functions in the 
context of survey sampling. A particular target of this 
attention has been the median, which is often regarded as a 
more satisfactory location measure than the mean, espe- 
cially when the variable of interest follows a skewed distri- 
bution. Traditional estimators of population means or totals 
can be usually substantially improved if relevant auxiliary 
information is made available. Consequently, the use of 
such auxiliary Information seems highly desirable in sample 
quantile estimators. 

Using a model-based approach, Chambers and Dunstan 
(1986) considered quantile estimators based on an estimator 
of the distribution function which do incorporate auxiliary 
information. Rao, Kovar and Mantel (1990) have proposed 
design-based alternatives to the model-based approach. 
They used simulation experiments to compare two quantile 
estimators, based on ratio and difference estimators, to the 
simple design-based estimator which makes no use of the 
auxiliary information. It should be noted that neither of the 
two design-based proposals requires knowledge of the 
auxiliary information for each unit in the population; it 
rather suffices to know only the corresponding quantiles. 
While the model-based estimator proposed by Chambers 
and Dunstan (1986) can be more efficient than its design- 
based alternative if the model is correctly specified, Rao 
et al. (1990) have pointed out the advantage of the design- 
based estimators under model misspecification. Chambers, 
Dorfman and Hall (1992) have compared these two 
estimators theoretically with respect to their consistency, 
asymptotic bias and variance under a population model. 
Their main conclusion is that neither of the two methods is a 


sharp winner. Dorfman (1993) has reevaluated the simu- 
lation results obtained by Rao et al. (1990) and proposed a 
modified version of their methodology, using model-based 
arguments. Variance estimators in the model-based ap- 
proach of Chambers and Dunstan (1986) and the design- 
based estimators of Rao etal. (1990) are discussed in Wu 
and Sitter (2001). 

Other related works on quantile and median estimators 
include that of Kuk (1988) who proposes quantile estimators 
under pps ( proportional to size) sampling and that of Kuk 
and Mak (1989) who use a method that is based on cross- 
classifying the individuals in the sample, according to the 
variable of interest and a single auxiliary variable. Meeden 
(1995) takes a different approach to construct a median 
estimator based on univariate auxiliary information, using 
the Bayesian concept of Polya sampling to impute all the 
target variable’s unknown population values via a ratio- 
based approach. Rueda, Arcos and Martinez (2003) have 
recently built quantile estimators that extend ratio, differ- 
ence and regression estimators in ways similar to those 
developed for the population mean. 

In this paper, we follow the concept of calibration which 
was first introduced by Deville (1988) in order to derive a 
quantile estimator. The calibration approach has gained pop- 
ularity in real applications, because the resulting estimators 
are easy to interpret and to motivate, relying, as they do, on 
sampling weights and natural calibration constraints. This 
approach was developed in the seminal work of Deville and 
Sarndal (1992) as an alternative means of incorporating 
auxiliary information in the estimation of population totals. 
The so-called calibrated weights are found by minimizing a 
distance measure between the sampling weights and the 
new weights, which need to satisfy certain calibration con- 
straints. For estimating totals the calibrated weights replace 
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the original design weights used in Horvitz-Thompson type 
estimators. When the new weights are applied to the 
auxiliary variables available in the sample, they reproduce 
the known population totals of the auxiliary variables 
exactly; it is for this reason that the estimators in this class 
are called calibration estimators. See also Singh and Mohl 
(1996) who provide simple justifications of calibration 
estimators. They also present a very general and unifying 
treatment of calibration methods whose weights satisfy 
certain range restrictions and benchmark constraints. 

Our fundamental aim is to propose calibration estimators 
for quantiles which are as easy to implement and interpret as 
the calibration estimators for totals developed by Deville and 
Sarndal (1992). When compared to the quantile estimators 
available in the literature, the new calibration estimators 
should also be competitive with respect to their bias, 
variance, and coverage rates of the confidence intervals. 
Early calibration estimators for distribution functions and 
quantiles include those proposed by Kovaéevic (1997), who 
considered estimators of the distribution function calibrated 
on moments of the auxiliary variables. Harms (2003) has 
investigated a similar approach, with applications to the 
Finnish European Household Panel survey. Ren (2002) 
appears to have been the first to develop a unifying treatment 
of calibration estimators for distribution functions and 
quantiles. The calibration estimators for quantiles presented 
in this paper continue the work initiated by Ren (2002). We 
adhere to the original calibration paradigm for totals as 
closely as possible: when the parameter of interest is a total, 
it seems natural to calibrate on totals of the auxiliary 
variables. In the present context, since the parameter of 
interest corresponds to a quantile, the calibration constraints 
require that the weights are such that the sample quantile 
estimators of the auxiliary variables and their corresponding 
population quantiles are equal. In other words, the weighted 
quantile estimators for the auxiliary variables should yield 
exactly the population quantiles, which are assumed to be 
known. We present arguments which justify calibrating on 
quantiles, whenever the parameter of interest is itself a 
quantile. Interestingly, our methodology does not necessitate 
knowledge of the values of the auxiliary variables for all 
units in the population. Since the resulting estimators display 
a structural form very similar to the original calibration 
estimators for totals, it is expected that, under general 
conditions, the proposed estimators for quantiles will be 
asymptotically design-unbiased. Furthermore, these simi- 
larities allow us to derive variance estimators which admit a 
familiar form. Contrary to some of the other estimators, the 
proposed approach is also applicable to vectorial auxiliary 
variables (that is, when several auxiliary variables are 
available), while requiring only minimal auxiliary infor- 
mation. However, some restricttions may apply when the 
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sample is highly unrepresentative of the sampled population 
or when the quantiles being estimated are very close to the 
population minimum or maximum. Note that highly un- 
representative samples can also cause problems for cali- 
bration estimators for totals commonly used; in such 
situations, the algorithm for computing calibration estimators 
may fail to converge for many distance measures of practical 
interest. 

The organization of the paper is as follows: In section 2, 
some preliminaries are given, including a brief review of the 
calibration estimators for totals. The new calibration 
estimators for quantiles are developed in section 3.1. The 
standard distribution function can be interpreted as a 
Horvitz-Thompson estimator, providing a possible approach 
to the construction of a calibrated distribution function 
estimator. Quantile estimators are then naturally derived by 
inverting the distribution function estimator (see e.g., Ren 
(2002)). As in calibration estimators for totals, design 
weights can be replaced by more general sampling weights, 
in order to take account the auxiliary information. However, 
for many situations of practical interest, it may happen that 
no solution exists for the calibration constraints when this 
kind of distribution function estimator is adopted, the reason 
being that this estimator corresponds to a step function. In 
order to avoid existence problems of solutions for the 
calibration constraints, a new distribution function estimator 
is introduced, based on the natural concept of interpolation. 
Under the common quadratic metric, an analytic represent- 
tation of the calibration weights is provided in section 3.2; 
variance estimators and confidence intervals are discussed 
in section 3.3. A practical aspect involves evaluating the 
methodology proposed with real populations and several 
sampling plans. Consequently, in section 4, we present a 
small simulation study where we compare our new ap- 
proach, with respect to variance, bias and coverage rates of 
the confidence intervals, with that of Chambers and Dunstan 
(1986) as well as with some of the estimators proposed by 
Rao et al. (1990). Finally, concluding remarks are offered in 
section 5. 


2. Some Preliminaries on Calibration Estimators 


In this section, we present the fundamental concepts and 
notations useful for the sequel. We also give a brief review 
of calibration estimators for totals. 

Let U ={1,..., k, ..., N} be a finite population of size 
N. Let T, = Xv y, be the population total of the variable of 
interest y, (note that fora set 4, ACU, >, will be used 
as shorthand for >,.,). A sample scU of size n is 
drawn according to a sampling plan. Let m, = Pr(s 3k) 
and mt, =Pr(s 3k, /) be the first and second order inclu- 
sion probabilities, respectively. We denote the design 
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weights d,=m,' and Mee =), ayy; 
Horvitz-Thompson (HT) estimator of Tis: 

Let x, =(X,, «.) X,)' bea vector of auxiliary variables 
associated with unit k, k © U. Calibration estimators natu- 
rally include auxiliary information in the estimation. Let 
s={k, ..., k,}, s CU. Starting with the vector of original 
weights d=(d,, ..., d, OE new weights are found which, 
when applied to the stairs variables available in s, make 
it possible to retrieve the known population totals for the J 
auxiliary variables T, = dy x, =(7,, ..., T,,)'. The cali- 
bration estimator for totals are more precisely defined in 
Definition 1. 


represents the 


Definition 1 (Calibration estimator for totals). Let d= 
(d,, ..-, d,)' be the design weights. The calibration esti- 
mator ep totals takes the form T), a, = Lis Wes Ve, Where the 
weights w,,, kes are obtained as the following mini- 
mization problem with respect to the variable v =(v,, ..., 
Vy)’: 


w =argmin, D(v, d), (1) 


subject to the calibration constraints >\,Vv, x, =T,, where 
D(,-) denotes the distance measure and w=(w,, ..-; 
w, )' corresponds to the vector of the calibrated weights. 


For notational simplicity, we write w, =w,, in Defi- 
nition 1 when no confusion is possible. It is common 
practice to let x, =1, Vk e@U, and consequently 7, = N. 
This means that the calibrated weights satisfy the natural 
constraint },w, =N. Many distance functions D are 
available in the literature (see, e.g., Deville and Sarndal 
(1992), Chen and Qin (1993), Thompson (1997)). Consider 
the quadratic distance function 


Oe ayy 
CAR 


D(v, d)= oe (2) 


where qg, determines the importance of the unit kes in 
the calibration problem. Heteroscedasticity problems can be 
handled using an appropriate choice of the g, ’s. Solving 
the optimization problem (1) using the Lagrange multiplier 
technique (see Deville and Sarndal (1992), among others), 
the weights w, =d,(1+q,x;,4,) are obtained, where 
We yg, XX), (Pe=/ls 7.) and 1.7, denotes the 
HT-estimator of T,. This choice of distance function leads 
to the weights of the well-known generalized regression 
estimator (GREG) of Cassel, Sarndal and Wretman (1976), 
which is studied in detail in Sdarndal, Swensson and 
Wretman (1992). Under minimal requirements for the dis- 
ance measure D, Deville and Sarndal (1992) have shown 
that all calibration estimators in this class are asymptotically 
equivalent to the GREG. For ease of interpretation and other 
cosmetic reasons, some users may want to have positive 
weights or restrict them to a specific interval (see also Singh 
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and Mohl (1996)). In practical applications, these numerical 
features of the weights seem to be the main motivation for 
an alternative choice of D. 


3. New Calibration Estimators 


In this section we develop calibration estimators for 
quantiles, using ideas similar to those leading to the cali- 
ration estimators for population totals, as described in 
section 2. The new calibration estimators for quantiles are 
introduced in the next subsection, using interpolated 
distribution function estimators. Then, special attention is 
devoted to the quadratic distance function. The last sub- 
ection presents variance estimation and the construction of 
confidence intervals. 


3.1 Definition of the Calibration Estimators for 
Quantiles 


Let Q, , =(Qy«» +» Qx,q)' denote the known vector 
of population quantiles for the vector of auxiliary variables 
X, =(X,, «5 X,)', K EU. The Heavyside function H(z) 


is given by: 
1 poe aaa 8 
hz) = 
OF 2), 


The population distribution function of a scalar auxiliary 
variable x is defined in the usual way as F\(t)= 
N'YyH(t-x,), and the population quantile Q, , 
obtained by letting QO, , = inf {t| F(t) 2 a}. 

The vector Q, , contains quantiles of the auxiliary 
variables, obtained from information in past surveys or from 
available administrative sources. For example, for skewed 
distributions which are rather common in business and 
economic surveys, it seems more natural to keep in the 
record files the population medians rather than population 
means; in this case it seems natural to assume the 
knowledge of Q, ,;. This suggests that, using the same 
approach as the one leading to calibration for totals de- 
scribed in section 2, the proposed estimator for the popu- 
lation quantile Q, , of the variable of interest y, noted 
QO) caiq> Could be obtained by inverting a certain estimator 
of the distribution function (that we discuss below), subject 
to calibration constraints such as Q, Medan Osada 
1, ..., J. Following the usual interpretation, if the calibrated 
weights allow us to retrieve the known population quantiles 
of the auxiliary variables then, under certain conditions, they 
should produce reasonable estimators for the quantile of the 
variable of interest y. 

More precisely, the calibrated weights are obtained by 
solving the following optimization problem: 


w = argmin, D(v, d), (3) 
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subject to the calibration constraints >,v,=N and 
Q. cal,a = (Op cal, a? -*" Os aig has Qre 
The estimators Q, a, and Q, oa. Tely on the vector 


of weights w, stemming from the solution of the calibration 
problem (3). To calculate these estimators for quantiles, we 
need to construct w-weighted estimators of the 
distribution function for variables x and y. Based on the 
sampling weights d, a natural estimator of the sampling 
distribution function is given by 


Fi(t)=> 4, H(t-y,)/>.,4, (4) 


which provides a consistent estimator of F,(7). Similarly, 
F(t) can be consistently estimated ie Fi yay ode 
H(t- Mudirdue Des tie= la ES We weighted distribu- 
tion function estimator of P. (t) 1s given by 


Fy cat) = D0, We A(t x4)/ D0, Me (5) 


A similar formula holds for jh ca (¢). These w— weighted 
estimators are considered in Ren (2002). However, if one 
estimates O, , by QO, , =inf{t|F. ()>a}, or makes a 
similar estimation using a w- weighted version, then it is 
generally not possible to reach an exact solution of the 
calibration problem (3). Indeed, if the previous definition is 
used to estimate the quantiles by inverting the distribution 
function using the previous definitions, then the constraints 
in the optimization problem (3) will not, in general, be 
fulfilled unless the sample s contains precisely a unit k 
such that x, =Q, ,. When J is large, this problem can be 
more pronounced. Furthermore, even if the sample does 
contain such a value, it is sometimes not possible to obtain 
the weights needed to minimize the distance function, the 
reason being that under certain circumstances, the weights 
fulfilling the calibration constraints form an open set, 
whereas the optimal weights lie precisely on the border of 
this set. The following example illustrates this situation. 


Example 1: 

Consider a population U of size ee 30, such that the 
population median of x is QO, );=2. A sample s of size 
n=3 is drawn, and suppose that x, =k, Vkes= 
{1, 2, 3}. For simplicity, the distance measure D(v, d) = 
>, (v, —d,)° is adopted; it is supposed that the sampling 
weights are (d,,d,;d,)= (5,9, 6): Based on (5), the 
calibration constraint is Q, 4) 95 =inf {t| F. ..(t) 20.5} = 
2, which implies that }.w,H(2-—x,)2= 15 and >, 
H(1—x,)<15. Equivalently, w,+w,215 and w, <15. 
Thus we have to choose w, of the form w, =15-—e, for 
€>0. In this case, since w, + w, + w, =30, we have that 
D(v,d) =e" +(w, -9)° +(w, -9-e)’, leading to the 
optimal solution (w,, w,,w;)=(15—¢€,9+¢€/2,6+€6/2). 
Consequently, for these weights D(v, d) = 3e°/2, which is 
obviously minimized when e—0. However, the limit 
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reduces to w =(w,, w>, W;) = (15,9, 6) with D(w, d)=0, 
but based on these weights QO, .4 95 =14Q, 05 =2. 

However, these difficulties can be naturally avoided by 
considering a smooth estimator of the distribution function. 
For simplicity, we consider here a distribution function 
estimator calculated using a linear interpolation (another 
possibility is discussed in section 5), which is precisely 
defined in Definition 2. 


Definition 2 (Interpolated distribution function estimators). 


Define 
a w, H, Ct. y; 
A (t= et " rash vi (6) 
> 
A » A, (t, Xj) 
Pee a ; - (7) 


Ds Me . 
where the Heavyside function H_ in (4) and (5) is replaced 
by the slightly modified function 


bs ye SE, Ct); 
A, 4, ¥) = B,. y, =U, .(t), (8) 
0, yp ON) 


where L, ,(t) = max{iy,, Kes|y, St} VU {of}, 
U,, (t)=min{{y,kes|y,>HUfo}} and B, (= 
VE De (OAC sb) aU) de MeaCriOn ele ae 
is defined similarly. The estimators (6) and (7), based on the 
functions H, ,(t, y,) and LT, ae x,), are called interpo- 
lated distribution function estimators of F(t) and F, (t), 
respectively. 
The various quantities in (8) have easy interpretations: 
L,,, and U, , represent the lower and upper neighbors of ¢ 
in the eipled values y,,k es, and B, .(¢) denotes the 
linear interpolation coefficient between these two quantities. 
In particular, for all te {y,,k es} we have H,, af yz.) = 
H(t—y,). Consequently, the relations F, veal (t) =F), ca) 
are satisfied for all te {y,,k es}. For ali the aoe made 
of t, F .,(¢) consists of a linear interpolation between these 
quantities. In the following example, Example 1 is revisited 
using the interpolated distribution function estimator (7). 


Example 2: 
In Example 1, using the interpolated version (7), the 
constraints are now w,+w,+w;=30 and (w,+w,)/ 
(w,f+w,+w;)=0.5. Consequently w, =15, w14+w,= 
15. Simple algebra shows that the optimal solution is 
(w,, w,, w;) = (10.5, 4.5, 15), which is now well-defined. 
With the me Rolaied distribution function estimators, 
4 F(a) and F’' (a) are now well defined « — quantile 
estimators for all a € (0, 1), as long as one can assure that 
Fn Me w, are all strictly positive. Letting es odie te 
a ~‘4q(), Wwe define the proposed calibration estimator 


peal 
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0. cal, for the quantile Q,,, using the interpolated distri- 
bution function estimator given in Definition 2. 


Definition 3 (Calibration estimator for quantiles). Consider 
the optimization problem (3), subject to the calibration 
constraints > ,v,=N and Or = (Oe ae. bu 
Oe clin Ox «, Solving this optimization problem and 
denoting the resulting weights as w, the proposed 
calibration estimator for quantiles of Q, ., is defined by 


alert = oO), (9) 


where i ca (t) is given by (6). 

One of the appealing properties of the proposed estimator 
(9) is that it yields exact population quantiles when the 
relationship between y and a scalar auxiliary variable x is 
exactly linear. Assume that y, =a+bx, holds perfectly for 
all units k «U and suppose that the units in the sample s 
are such that x,<Q,.,<x, for some units x, and 
x,,k,/€s. For the calibrated estimator (9), we have that 
F. a(Q, ,) =a. We need to distinguish the two cases, 
b>0 and b<0 (The case 6 =0 is trivial since y, is then 
identically equal to a constant). Firstly, consider the 
situation b>0. Since the linear relation y, =a+bx, 1s 
satisfied for all units k and since b>0, the following 
relations hold: L, .(a+bt)=a+bl, ,(t);U,,,(a+bt) = 
a+bU, ,(t) and B, .(a+bt)=B, ,(¢). These relations 
lead to H, (at+bt,y,)=H, ,(t,x,)- It follows that 
F, (a+ bt) =F, .,(¢). Furthermore, F,, .,(a+ 0, ..) = 
a and using the relation a+bQ,. , =Q, ,, we deduce that 
F, cal (Q),.) =a. Consequently, when an exact linear 
relationship holds and 5>0, OQ, cal, = ee (a)=Q, ,. 
Secondly, consider the case b < 0. We deduce in this case 
the following relations: L, (a+ bt)=a+bU, ,(t); U,, , (a+ 
bt) = a+b, (t); B, .a+bd)=1-B, ,@) and A, (a+ 
bt, y,) = 1— H, ,(t, x,). Since b<0, the relationship 
between the quantiles of x and y is given by a+bQ, ,= 
O, 1-4. Then, we deduce that Fy, a (Q,1-a)=Fy calla + 
bO. ,)=1- Fy. «a (Q, .) =1—a. Thus, in this situation, 
QO, 18 estimated exactly by 0, cal, his means that, 
when an exact relation holds, if b5>0 the proposed 
calibration estimator ps cal yields perfect estimators with 
zero bias and variance of Q, ,. On the other hand, if b < 0 
and calibrating on Q, ,, oe is estimated exactly by 
Q,,ca,1-« (Which makes sense because the perfect linear 
relationship between x and y is such that the slope 
parameter is negative). 

Note that when F eqnand Pinon are invertible at points 
Q,, and Q, ,, the calibration constraints in (3) can be 
rewritten in terms of the distribution functions, that is the 
calibration constraints based on the quantiles are equivalent 
to Fal Qiang) oft = 1 Gy tine Lins ameanss iiata tbe 
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original calibration problem can be alternatively written in 
terms of distribution functions with the above constraints. 

A natural question arises as to the existence of a solution 
to the optimization problem (3). Even when formulated with 
the interpolated distribution functions, it is not always 
possible to find a solution to (3). For example, if QO, , is 
smaller or larger than all values x, in the sample s, then 
F. .4(Q, ,,) will equal zero or one regardless of the choice 
of the wei ghts w. Thus in these cases it may happen that the 
calibration constraints cannot be fulfilled. However, when 
the sample’s behavior differs widely from that of the target 
population, one should keep a very critical eye on any 
adjustment, and this situation can be considered somewhat 
extreme. In practice, this rarely occurs unless a is chosen 
very close to zero or one. Note that it may be impossible to 
obtain a solution when the sample size 7 is small. In these 
situations, the sample minimum or maximum could serve as 
a possible estimator or we could resort to the simple design- 
based estimator of the distribution function. 

The second potential problem is that some weights w, 
might be negative. In this case a ca) 1S NO longer bijective. 
This is not a problem as long as Fo 1 (2) is still uniquely 
determined. This problem can be avoided by restricting all 
the weights to be strictly positive, using an appropriate 
metric D(.-:). This approach has been adopted by 
Kovaéevic (1997) (for more details on distance functions 
yielding positive weights, see also Deville and Sarndal 
(1992) and Singh and Mohl (1996)). 


Remark 1: 

The proposed distribution functions estimators (6) and (7) 
rely on a linear interpolation. In a unified way, the 
population distribution function, which is a step function as 
well, could also be defined using a linear interpolation. In 
practice, the two definitions differ only slightly in behavior, 
if the population N is sufficiently large. However, it should 
be noted that if the population size N is relatively small, it 
might be worth using an interpolation to define distribution 
functions. 

Remark 2: 

In the optimization problem (3), we calibrated on a 
particular quantile. This approach could be extended by 
allowing to calibrate on a finite set of quantiles, if such 
information is available. More precisely, suppose that for an 
auxiliary variable x, the a,,— quantiles QO, , ,m=l, ..., 
M are known, where M <n-1. In this case, we could 
consider the calibration constraints F. ..(Q, of 40,5 m= 
1, ..., WW and solve the optimization problem (3) with these 
additional calibration constraints. Naturally, this information 
yields a more complete description of the distribution of the 
auxiliary variables; so the efficiency of the calibration 
estimators is expected to be higher. 
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Remark 3: 

The proposed calibration estimator (9) is obtained by 
calibrating on population quantiles. Another possibility has 
been considered by Ren (2002) who calibrated on 
population moments, up to order m, of the same distri- 
bution. More precisely, Ren (2002) has proposed calibration 
estimators for quantiles satisfying constraints of the form 
sx = Xy x, m=0, 1, ..., M. Calibration on different 
moments of the same distribution is closely related to 
calibrating on different quantiles of the same variable, and 
all these constraints provide a more complete description of 
the distribution of the auxiliary variable. For other 
generalizations of the calibration paradigm on moments, see 
also Ren and Deville (2000) and Harms (2003). 


3.2 Analytical Solution of the Calibrated Weights 
when D is the Quadratic Metric 


When the quadratic distance function (2) is adopted, an 
explicit solution of the optimization problem (3) can be 
derived. This situation is similar to the calibration estimators 
for totals, where the weights of the GREG estimator are 
explicitly obtained under the metric (2). A careful analysis 
of the estimation problem for quantiles reveals important 
similarities, the reason being that the estimators given by (7) 
are weighted sums of the variables he Maa XJ, KES}, 
j=1,..., J. This is stated in Proposition 1. 


Proposition 1 (Calibrated weights for the quadratic metric). 
Consider the quadratic distance function (2). The vector of 
weights w which solves the optimization problem (3) 


satisfies the relation: 
w, =d,0 i+ q,a,A,); kes, (10) 


where the vector X., =(Ao, ..., 4,)' is determined via the 


J +1 constraints as: 


d = pinch Ue Ay eel ome: a,), 


With LCN, Os ass Oe) 


(11) 


and the components of 


a, =(1, a, ..-. @,.) are given by 
N™, X ik < Lae) 
a ik = ar OA ae X ix ia Oss ates Jt 
0, X ik e Oy Owes 
WHO fice dos, Se 


Proof. To prove Proposition 1, first note that, since the first 
constraint },w, =N must be satisfied, it follows that 
Fo (= Ney w,H, ,(t, X,,). Proceeding as in Deville 
and Sarndal (1992), we can show that the vector a, = 
Ca as; He) cedieatice 
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, (12) 


Das Wr =N; Lee (Q, a) =a, pale sera. J 


that we now evaluate explicitly. Evaluating the derivatives, 
we have that a, = ice ene Bas =, Je eee 
uatedat t=Q, ,. This leads to 


-| 
N > X ik 8 bree (es 


Or ¥ NBs (Ours X ix = Oe ae 
“ X ik - Go ON..)s 
j=l,..., J, as announced. 


In (11), T, can be interpreted as the expected value of 
>, d, a,. The derived weights (10) in the distribution 
function estimator (6) rely on the variables a,, kes 
defined by (12). Note that they correspond to a certain 
transformation of the auxiliary variable x,. The difference 
between the weights for totals and quantiles relies on this 
variable a,; when a, is replaced by x,, we retrieve the 
original weights for totals. Consequently, it is useful to 
interpret this new variable. When estimating a total, the 
impact on the j" calibration constraint is measured by x ik 
for each unit k es. In our framework, the impact of the unit 
k is now given by N” if xy, SOE, (Oe% )aeat 
corresponds to the factor N”'B, .(Q. .) ‘when x, = 
U, ,(Q, ,,) and it is null elsewhere. In section 5, we shall 
discuss other estimation problems, leading to different 
variables a,. 

Noting the similarities between the estimation of totals 
and quantiles, variance estimation can also be considered. 
This issue is addressed in the next subsection. 


3.3. Variance Estimation and Confidence Intervals 


As described in the previous section, the estimator 
Ours displays several similarities to the usual GREG 
estimator for population totals. The transformed variables 
given by (12) provide the main difference between the 
calibration estimators for quantiles and totals. Interestingly, 
because of the structural similarity with the original 
calibration estimators, it is straightforward to derive a 
confidence interval for the proposed estimator Q, .,, ,. We 
consider the construction of confidence intervals following 
Woodruff's (1952) approach. The confidence interval is 
given in Result 1. 


Result 1 (Woodruff confidence interval for the calibration 
estimator for quantiles). The confidence interval based on 
Woodruff’s (1952) approach, using the calibration 
estimator (9) for the quantile QO, ,, is given by 


Survey Methodology, June 2006 


Ep Gm eer Grlh (13) 


where ¢,, =4—-2,_,/2[ a (Oe ae and ¢,,=a+ 
Las PEE eu Ones, Vie), The resulting procedure yields 
an approximate confidence interval for Q, ,, at a specified 
1—y confidence level. 


Proof. Assuming that FAI 3 OOTY) is approximately 
normally distributed, it follows that Pr(q,, af Pin 


(QO, .)<,) should approximately be equal to 1—y, if 
one chooses 


eT ay saan Mg 0 Dime (9) Yeh (14) 
Cry me « Zy-y/2L ALOR Ae (15) 


where z, denotes the y" — quantile of the N(0,1) standard 
normal distribution. Since F’, .., ,(Q,...) represents essen- 


tially a sample mean, a possible variance estimator justified 
by the classical Taylor linearization is given by 


de A A 
VAP Oph = NT 2. Dim 4) OM es (16) 
Al 


where A,, = 7, — 1,7); the weights w,,k €s, correspond 
to the calibrated weights (3) which reduce to (10) when D 
is the quadratic distance function (2); the residuals are given 
by & = ale (OQ, saves a, B, where 


P £4 
B, =(S™, Vx Ay a) ee Gy Oy Ht AO a cs Ye) 


represents the regression coefficient estimator. Since the 
constants ¢,, and c,, given by (14) and (15) rely on 
ViF, .ai(Q)4)}, We can estimate these quantities using the 
variance estimator (16). 

In Result 1, note that Deville and Sarndal (1992) 
advocated a w— weighted variance estimator similar to (16) 
for estimating the variance of the calibration estimators of 
the population totals. The performance of the proposed 
calibration estimator (9) and the confidence interval given 
by (13) are studied empirically in section 4. 


4. Simulation Results 


From a practical point of view, it is natural to inquire 
about the finite sample properties of the new calibration 
estimators and to compare them to popular estimators for 
quantiles available in the literature. In this section, simula- 
tion experiments are undertaken, to illustrate empirically the 
new estimators. In particular, their empirical bias and 
variance in real populations are investigated. The coverage 
properties of the confidence intervals represent another 
question of practical interest, which is also studied. 

In partial answer to these questions, we carried out three 
small simulation studies. For several sampling plans and for 
real populations, the proposed calibration estimator for 
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quantiles is compared to its popular competitors. In the next 
subsection 4.1, we describe in detail the populations 
investigated and we discuss the sampling plans chosen. In 
subsection 4.2, the estimators included in the empirical 
study are presented and, in subsection 4.3, the frequentist 
measures (empirical bias, variance and mean squared error, 
coverage rates of the confidence intervals) are described. 
Our empirical results are analyzed in subsection 4.4. 


4.1 Description of the Real Populations and the 
Sampling Plans 


The real populations are displayed in Figures | to 6. The 
first population, noted MU284, is taken from Sarndal et al. 
(1992, Appendix B). This population consists of N = 284 
municipalities in Sweden. We retain as variable of interest 
the population in 1985 (variable P85), and we assume that 
the auxiliary information available is the population in 1975 
(variable P75). Both variables are measured in thousands. In 
Figure 1, the variable P85 is expressed as a function of P75; 
as expected, the relationship between P85 and P75 is 
strongly linear. The variable P85 follows a highly skewed 
distribution, as shown in Figure 2. In this population, 500 
samples were drawn according to simple random sampling 
without replacement (SRS). In addition, the same study was 
carried out under a sampling plan with unequal proba- 
bilities, the Poisson (PO) sampling scheme. The properties 
of the PO sampling plan are described in Sarndal et al. 
(1992). Due to the wide range of values for y, it was not 
possible to construct sample selection probabilities nm, of 
the form 1, < y,, since this would mean that some 1, had 
to be greater than one. For the purpose of our illustration, we 
determined selection probabilities using the relation 
mt, <0.2y,+0.05 (we recognize that these 1,’s are 
idealized, since y, is not available in practice). Under the 
SRS sampling plan (PO sampling plan), we considered the 
sample sizes (expected sample sizes) n= 25 and n=S0. 
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Figure 1. The Population MU284, where y= P85 and 
x= P75. 


For the second study, we chose the MU284 population, 
but now made the variable of interest y=RMT85, which 
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represents the revenues from 1985 municipal taxation (in 
millions of kronor). Here the auxiliary variable chosen is 
x =REV84, which denotes real estate values according to 
1984 assessments for each municipality (in millions of 
kronor). As can be seen in Figure 3, the relationship between 
x and y is somewhat spread out for larger values of x. The 
histogram of the variable RMT85 reveals that it follows a 
skewed distribution (Figure 4). For this study, 500 samples 
were drawn according to the SRS scheme of size n = 25 and 
n=50; 
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Figure 2.Histogram of the Variable P85 in the MU284 
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MU284 Population. 
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The third population is based on a random subsample of 
the Survey of Labor and Income Dynamics, noted SLID982. 
The survey was conducted at Statistics Canada in 1998. For 
simplicity’s sake, only entries with no missing values were 
selected. The size of the subsample is N = 2,000 and for our 
purpose this is assumed to be a population (the original 
sample size of this survey is approximately 60,000). Taxable 
income (in thousands of dollars) is the target variable and the 
auxiliary variable is the duration in months of the current 
employment. From Figure 5, the linear relationship between 
taxable income and length of employment is less pronounced. 
However, the two variables do not appear to be independent. 
In Figure 6, the variable of interest exhibits a strong 
coefficient of skewness. We have drawn 500 samples from 
the SLID982 population, according to SRS and PO sampling 
plans. The sample sizes (expected sample size) n =100 and 
n=200 were considered. For PO sampling, the first order 
probabilities, m,,4<U, were defined according to two 
rules. Under the first rule, the 7, ’s were created such that 1, 
is approximately proportional to the variable of interest, that 
is taxable income (for the purpose of our study we assume 
that it is possible to create such 1m, ’s). Since some y, are 
negative in this population, we chose p,, =y, - 
min{y,, keU}$+1 and we defined 2, =E(n,)p,/ 
dv Pi,» Where E(n,) stands for the expected sample size, in 
our case E(n,)=100 and 200. Under the second rule, the 
7, S Were proportional to the entries in Table 1. This means 
that for each k €U, there exists a factor p,,, which is 
determined by the age-sex group of individual k. Then 
Tt, = E(n,)P>,/dXv Po,» Where the factors p,, are given in 
Table 1. The factors p,, in Table 1 are based on a 
hypothetical sampling plan, in which we assume that these 
factors provide suitable size measures for the units in the 
various age-sex classes (see e.g., Sarndal et al. (1992, page 
87)); for these units, more males than females are likely to be 
selected and, for both sexes, adults in the 27 to 37 and 38 to 
46 age range are more likely to be included in the sample. 


ry 
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Figure 5. The SLID982 Population, where the Dependent 
Variable is the Taxable Income and Independent 
Variable is the Duration of Current Employment 
(in Months). 
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Figure 6. Histogram of the Taxable Income in the 
SLID982 Population. 


Table 1 
Factor p,, by Age and Sex of Individual &, 


in the SLID982 Population 
Age 
16—25 27-37 38—46 47-69 


Sex Male 3 6 5 4 
Female 1 D 3 2, 


In these three studies, we estimate the quartiles, that is 
the population parameters Q, , with a=0.25, 0.5 and 
0.75. Since the variables of interest display highly skewed 
distributions, it might be particulary interesting to study the 
quantile corresponding to a=0.75, in addition to the 
median and the first quartile. The next section describes the 
estimators included in the study. 


4.2 Estimators Included in the Empirical Study 


Since one of our goals is to propose estimators with 
reasonable properties with respect to bias, variance and 
coverage rates of the confidence intervals, we compare the 
new estimator defined by (9) based on the metric (2) to some 
of the popular quantile estimators proposed in the literature. 

First, we include the simple design-based estimator based 
on the inversion of the estimator F yh) = is Gp dls lb Ve) 
RLS 

Q,u11,0 = Fy (@). (17) 


The estimator (17) does not make use of auxiliary infor- 
mation. A possible variance estimator is 


VFO, a)}= 
a A, H, (Q HT,» Ye) — O) 
—2 kl y, S ), 50.8 
Na ND hes Ein the Se percent 
Ty Ty 


9) 


Tl) 


45 


where N = >»,d,, and confidence intervals can be calcu- 
lated using 


arte ieee 


where 
Co ene ls (18) 


Cy, So BAS (VP (Oye (19) 


For more details, see Sarndal et al. (1992, page 202). 

We also include in our empirical study the model-based 
estimator of Chambers and Dunstan (1986), which is 
motivated by a linear superpopulation model y, =B, + 
B’x, +e,, k e€U, where e, forms an identically and inde- 
pendently distributed sequence of random variables with 
mean zero and finite variance. Their estimator is defined as 


OV REET EP OE(7) aay. (20) 


where FY, on () = N'{E, H(t- yy) + Lv), G@-I,)} trep- 
resents a model-based estimator of the distribution function, 


Gluj=n' > Hu-é,) (21) 


denotes the empirical distribution function of the residuals 
€, = —Ve, KES, and V, =f, +B’x,, keU/s corre- 
spond to the least-squares predictions. Since the estimator 
(20) basically imputes the unknown y, for k eU/s, note 
that it necessitates a complete knowledge of x, for k eU. 

The construction of a confidence interval for Q) cp ,, 
relies on estimating the variance V {F' », cD (t)}- However, this 
variance estimation problem creates difficulties, since any 
analytical variance formula depends on the assumed model. 
Furthermore, such analytical expressions involve kernel 
density estimators, which are numerically intensive and 
depend on a kernel function and a bandwidth. For all these 
reasons, we decide to implement the delete-one jackknife 
variance estimators studied in Wu and Sitter (2001), who 
have shown the consistency of the proposed variance esti- 
mators. In the context of survey sampling, various resampling 
methods, including the jackknife, are introduced in Kovar, 
Rao and Wu (1988). The jackknife technique involves 
deleting a unit and re-calculating the estimator. Let s, = s/{i} 
be the sample without unit 7. Consider Bo, and B,. the 
regression estimators of 8, and B calculated on s,. Under a 
simple regression model, define 


si 
N eats 
HOG ae =B(%; SNe es 


A consistent variance estimator of ViF co(Q,,cp,a)} 18 
given by 


F, ce (n = NG: Dee 
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A A n—l * — 
Vico {F,, cp (Qy, a5 = oe (Ff; ati ie 
eee 
HD 
Sls CDio) a d,;) {l a e/(O ae Dds 


where f =n/WN is the sampling fraction, Tek ee 

and G is given by (21). Based on VF, Pol O avis: lals 
now possible to calculate the confidence intervals for Ore. 
using the inversion approach. 

Since our method necessitates only the knowledge of the 
vector of quantiles Q, .,, we include in our study the ratio 
and difference estimators for the quantiles studied in Rao 
et al. (1990): 


Oped, One a ates (22) 


0 diff, a a O, HT, a + R (Om, a O. HT,a ), (23) 


where Ou is given by (17) and Ox HT,¢ 1S calculated 
similarly; the ratio estimator given by R= >,d,y,/ 
>, a, xX, provides a consistent estimator of R= Dy y,/ 
dv x;,- Note that the estimators (22) and (23) are elaborated 
based on a scalar auxiliary variable, that is J=1. Valid 
variance estimators of (22) and (23) are given by: 


VO, ra, a ) 7. VO, Hi. ) 


in D 

QO, HT, a ee 
Ba pe, VQ, ura) 

x BT Oo: 

0, Hive 273 bal 
is CQ) uta QO. ut.a)> 


x AI ;.o 


VO, diff, a) 3 VO, HT, «) 
+R°V(O, ura) 
-2RC(Q, HT, o? Ox HT, as 


These variance estimators rely on the variance of OF rca 
and the covariance between O. ATsas ne O. HT.o, Which are 
estimated using Woodruff’s (1952) approach: 


5 


A 


VQ, HT, Ss 


b) 


4z ae 

CO, HT, a? O. Ht, «) as 
WWF Qea Fy Quad} 
42? (VIF, IVE ©, JH? ’ 


eS W = je Coe Vid (ey) and W,= uke ca 
FUG) denote the Woodruff intervals aesociited with y 
and x, with Gy and Coy defined by (18) and (19), @, = 


AF Y LV {F, kOe a} aes » ©, ya AT Zy_ le (oe A de 
and 
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CA (Go bet 
> EG SIS 


Ty 


Ho > sree Kym Oh 


Tl) 


Summarizing, we expect oe to perform well when 
the linear model describes the population adequately. This 
motivates the comparison of the new methodology with a 
model-based estimator. Furthermore, it seems of interest to 
evaluate O,, cal. and the leading design-based proposals, 
such as oy a and O, raga: Lhe estimators OQ aare 
O, de ge and O,,... use 0,8. “only to. improves the 
estimations and they take into account the sampling plan; 
these estimators are natural competitors. Note that the 
different estimators included in our study are elaborated 
under different assumptions on the dimension of the vector 
of the auxiliary variable x, and on the availability of x,. 
Table 2 provides a comparison of the different estimators 
described in this section. 


Table 2 
Comparison of the Proposed Calibration Estimators and of Some 
Leading Estimators for Quantiles Proposed in the Literature, with 
Respect to the Dimension J of x and the information 
requirement on x 


_Estimator Dimension of x__Information requirements on x __ 
O,. HT, a N.a. none 
ON. fa x,,keU/s 
On Ta, a J=1 a 
Oj; diff, a J=1 One 
OF cal, a J21 Oy 


4.3 Frequentist Measures 


Our goal it to evaluate the estimators with respect to bias 
and variance. Other important considerations are the mean 
squared error (MSE) and the coverage rates of the confidence 
intervals. 

Bet Om be an estimator of the population quantile 
Os Assume (hee is the estimator of the quantile calcu- 
lated using the sample v, v=l, ..., K. The Monte Carlo 
mean £\,., the Monte Carlo bias By,., and the Monte Carlo 


variance V,,.. are given by the usual formulas, that is 
Exc(Qy.)=K Syl 
Buc = E oly Trae eee 


ET IOSA ETS, pace — Eyc(Q, )}- 
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Our main criterion for determining efficiency is the Monte 
Carlo MSE, defined by MSEyco =K™'D*, (OM, - 
QO, ,)’. The confidence intervals are calculated at the 95% 
confidence level, according to the procedures described in 
the previous sections. For an estimator Oy. and its 
variance estimator V), v=1, ..., K, the coverage rates at 


the 95% confidence level are calculated as 


Chu, )= 
K Ca 
211 \<[ae-1.96/P™, 6 41.96/77] 


where /(A) is the indicator function of the set A. The 
coverage rates are given below the column CR. We recall 
that we adopt K = 500 for all studies. 


4.4 Discussion of the Empirical Results 


The results are presented in Tables 3 to 8. We first 
discuss the results from Tables 3 to 4, when sampling the 
MU284 population with SRS and PO sampling plans. As 
can be seen, all the estimators display a similar behavior in 
both studies. The model-based estimator QO, cp ,, appears to 
be the most efficient among those analyzed when examining 
a = 0.75 and is in general very efficient. This was expected, 
since the relationship between x=P75 and y=P85 is 
strongly linear and the model-based estimator assumes a 
simple regression model. However, for a@=0.25 the 
differences in efficiency are less pronounced with respect to 
the other estimators based on auxiliary information. Among 
the estimators using only Q,, as information on the 
auxiliary variable, a rather similar performance is obtained. 
When the sample size is small, coverage rates usually 
deviate from the 95% nominal level. This is particulary true 
for the coverage rates of O which are somewhat 
underestimated. However, some improvement is observed at 
n=50, illustrating the consistency of the procedures 
studied. On the other hand, those of Oe and OF den, 
are always one. This suggests that the variances are 
overestimated for these estimators. Due to an important 
component of bias in the MSE, the coverage rates of the 
model-based estimator sometimes deteriorate as the sample 
size increases. The best coverage rates are obtained by using 
the simple HT estimator, O, 4; ,, which is however less 
efficient than the other estimators. 

Table 5 shows the result for the second population, which 
is the MU284 population but with y=RMT85 and x= 
REV84. Figure 3 seems to show a _heteroscedasticity 
phenomenon in this population. In view of this, since the 
ratio estimator is justified when the underlying population 
displays such behavior, it is not surprising that the ratio 


y,cal,a? 


47 
estimator One. 2 performs well in this particular situation; 
if outperforms Or diff, 1n Several cases. For a small sample 
size, the ratio estimator generally behaves better than 
Ou Te. However, for n=50, the calibration estimator 
appears to perform as well or slightly better than the ratio 
estimator. In this experiment, the bias and variance of the 
model-based estimator Oper increase the MSE substan- 
tially. Furthermore, in some cases, confidence intervals for 
this estimator could not be obtained, since the Woodruff 
method is not appropriate in cases with extremely large 
variance (the Woodruff interval becomes too large and the 
linearity of the distribution function within this interval can 
thus no longer be assumed). We suspect that a model taking 
into account heteroscedasticity might improve the perfor- 
mance of the model-based estimator. This highlights the fact 
that to obtain high efficiency with model-based estimators, 
the model must be correctly specified. 

The results in Table 6 to 8 concern the SLID982 pop- 
ulation, under SRS and PO sampling plans with two rules 
for the 1,’s. All the estimators in Table 6 perform 
reasonably well in estimating the first quartile and the 
median, except for the ratio estimator Oe which is the 
least efficient. Since the relationship between the dependent 
and independent variables is not precisely a linear model, 
this may partially explain the poor performance of the ratio 
estimator in this case. The relationship between x and y is 
not proportional and so the difference estimator QO), gis ¢ 
appears preferable to Oa However, for a = 0.75, these 
estimators show the highest MSE, being both the least 
efficient. Interestingly, in this part of the experiment 
ON dominates the design-based estimators in terms of 
MSE. However, for small «a, One and One 
perform similarly. It should be noted that for a larger sample 
size, Oe ar and OWon3 give the best efficiencies for the 
median and the third quartile. In fact, the model-based 
estimator Onan slightly outperforms Oe 3, but it 
should be noted that it uses more auxiliary information than 
Oa: 

Tables 7 and 8 present results under PO sampling plans. 
In general, design-based estimators perform much like those 
under SRS sampling plan. This is not the case for the 
model-based estimator; it is less efficient, likely because it 
does not incorporate the information about the sampling 
plan. More precisely, Table 7 presents simulation results 
under PO sampling, using the first rule for the 1, ’s, k e€U. 
Coverage rates of the model-based estimator are particularly 
disappointing in this experiment; the components of bias 
were too important in the MSE. The design-based 
estimators provide much closer empirical coverage rates, to 
the nominal 95% confidence level. For moderate and large 
i. ene is the most efficient estimator. In fact, the 
calibration estimator Ove performs well in this 
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experiment. Finally, Table 8 presents results obtained under = and _ the median, and Of noes is the least efficient for 
PO sampling with the second rule for the 7, ’s. In this case, a =0.75. In general, O dominates the other esti- 


y, cal, a 


O., ., «- 18 the least efficient estimator for the first quartile mators in this situation, offering the highest efficiency. 


Table 3 
Monte Carlo Simulation Results for Sampling from the MU284 Population, y = P85, x = P75, Under SRS Sampling Plan. 
The Number of Replications is Set at K = 500 


n=25 n=50 
Oo Estimator Buc Vac MSEwuic CR Buc Vac MSEwmc CR 
O25 eae aa —0.0343 0.5075 0.5077 0.886 —0.0499 0.2437 0.2457 0.828 
O, HT. —0.0266 2.3196 Pal Sa 0.952 0.0035 1.1087 1.1065 0.936 
On eis —0.1444 0.3869 0.4070 1.000 —0.0774 0.1684 0.1741 1.000 
0, diff, o —0.1486 0.3901 0.4114 1.000 —0.0734 0.1723 0.1774 1.000 
Oo; CD. 0.4855 0.2791 0.5143 0.906 0.5485 0.1981 0.4985 0.824 
0.5 Ores —0.2762 1.6499 229 0.918 —0.2835 0.9585 1.0370 0.944 
om HT, o 0.2605 12.5161 12.5589 0.922 —0.0064 5.8466 5.8349 0.916 
0, ee —0.2586 0.8828 0.9479 1.000 —0.4296 0.6701 0.8533 1.000 
Of diff, o =U. TI) 0.9898 1.0648 1.000 —0.4331 0.7492 0.9352 1.000 
O, cv, « 0.9431 0.4054 1.2940 0.866 0.9884 0.2410 2075 0.714 
0.75 O, ao —0.6229 3.3241 3.7055 0.614 —0.3661 1.8107 1.9411 0.710 
Or HT. a —0.1414 53.1951 53.1088 0.948 —0.3692 18.8586 18.9572 0.964 
Q,, oe =071925 3.0021 3.6242 1.000 —1.0004 1.4594 2.4573 1.000 
Oy, diff, o —0.8230 3.4379 4.1083 1.000 —1.0396 BS267 2.6044 1.000 
Or CD. 0.4343 0.5108 0.6984 0.954 0.4485 0.2618 0.4624 0.974 
Table 4 


Monte Carlo Simulation Results for Sampling from the MU284 Population, y = P85, x = P75, Under PO Sampling Plan. 
The Number of Replications is Set at K = 500 


n=25 n=50 
a Estimator Buc Vuuc MSEwc CR Buc Vurc MSEmc Cr 
0.25 0, ee —0.0441 0.4886 0.4896 0.888 —0.0169 0.2601 0.2599 0.828 
On HT. a —0.1698 2.2825 2.3068 0.936 —0.0384 1.1828 1.1819 0.928 
om aa —0.1509 0.3857 0.4076 1.000 —0.0913 0.2100 0.2179 1.000 
oF diff, —0.1634 0.3821 0.4080 1.000 —0.0877 0.2149 0.2221 1.000 
O, cd.0 0.6709 0.3310 0.7805 0.896 0.8792 0.1339 0.9066 0.554 
0.5 0. Calne —0.3610 1.4881 1.6155 0.920 —0.3236 0.8833 0.9863 0.936 
O:. HT. « —0.0612 11.3969 11.3778 0.926 THe? S.20)2 S.5002 0.906 
QO: ae =O) 3/35 1.0009 1.1385 1.000 —0.4130 0.5486 0.7181 1.000 
Q,, diff. o —0.3962 Laan 1.2818 1.000 —0.4217 0.5962 0.7729 1.000 
O, cp, F 1.1740 0.4947 1.8719 0.820 13297 0.2146 1.9822 0.474 
CIS NO can —0.6420 2.6605 3.0674 0.608 —0.4476 1.6212 1.8183 0.708 
ex HT. —0.6200 51.2934 Doon 0.956 —0.6632 17.3625 17.7677 0.966 
OQ, ae —0.8686 2.8841 3.6329 1.000 —0.9683 1.6494 2.5837 1.000 
O,. diff, « —0.9025 2.9826 AY 1.000 = LOL77 1.6340 2.6665 1.000 
O, cD, a 0.4620 0.4501 0.6627 0.982 0.5388 0.2329 0.5228 0.980 
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Table 5 


Monte Carlo Simulation Results for Sampling from the MU284 Population, y = RMT85, x =REV84, Under SRS Sampling Plan. 
The Number of Replications is Set at K =500 
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Monte Carlo Simulation Results for Sampling from the SLID982 Population, Under SRS Sampling Plan. 


Estimator 


gy cal, a 


na 


oe Hr, o 


A 


Q,, ra, @ 


A 


O,, ais 6 


One 


na 


Obs cal, a 


A 


O, HY a 


A 


UP Ta, 


One. 


C. CD, a 


Us cal, 


aN 


CF: HT, a 
Of ra, O 
Oe. diff, a 


na 


Q,, cp, a 


Buc 
1.0161 
0.3733 
3.0025 
BES 

—16.5165 


=T.6219 
0.0075 
0.7712 
0.3415 
17.6124 


—5.3477 
—4.6352 
—1.4390 
—5.3988 
49.3038 


Wa 2) 

Vic MSExc 
51.5421 52.4714 
110.2572 110.1760 
65.4135 74.2979 
107.7891 114.3084 

1661.0257 —1930.4983 
215.0326 217.2330 
763.6236 762.0964 
212.8298 212.9988 
283.6718 283.2210 
190.0045 499.8199 
1023.6924  1050.2431 
3526.8202  3541.2514 
980.5573 980.6669 
1464.7867 =1491.0041 
2153. 821s W5179 1826 


CR 
0.892 
0.960 
0.998 
0.994 
0.990 


0.870 
0.910 
0.996 
0.998 
n.a. 
0.826 
0.938 
0.994 
0.996 


Nn.a. 


Table 6 


Buc 
0.6499 
0.3383 
2.3856 
2.4083 

=17:3217 


—0.3419 
—0.3977 
—0.2810 
—1.0104 
13.5037 


4.7339 
—5.8890 
—2.0070 
—3.9008 
49.4089 


The Number of Replications is Set at K = 500 


n=50 

Vac MSExc 
24.0662 24.4404 
47.2921 47.3120 
30.7284 36.3580 
55.6977 61.3862 
820.7447 1119.1443 
1182125 118.0930 
331 235i 330.7314 
136.4382 136.2443 
201.3707 201.9889 
100.2106 282.3611 
443.0660 464.5896 
1242.4858 = 1274.6812 
5550159 558.4305 
744.1604 757.8881 
1488.9734  —3927.2324 


n=100 n= 200 

BRyc Vuac MSEwic CR BRuc Vuuc MSEwc 
0.1360 3.0390 3.0514 0.956 07331 1.6787 137297 
—0.0596 3.6099 3.6062 0.946 0.0499 19270 139263 
0.3067 6.8815 6.9618 0.970 0.0910 3.0743 3.0764 
—0.0504 2.9691 2.9657 0.980 0.0198 1.6139 1.6111 
1.1042 2.1180 2.3329 0922, [£392 1.2934, 2.5888 
—0.4034 6.3364 6.4865 0.966 —0.1402 2.9940 3.0076 
—0.4157 7.4589 7.6168 0.918 —0.1894 3.5865 36151 
0.7015 41.8314 42.2399 0.958 0.2238 18.7005 18.7131 
—0.4859 14.2083 14.4160 0.970 —0.2740 6.6184 6.6803 
0.5702 3.5420 3.8601 0.952 0.6697 ae) 2.2009 
—0.4164 12.4657 12.6142 0.952 —0.2384 5.9118 5.9568 
—0.5913 12.5456 12.8701 0.930 —0.3519 6.5496 6.6603 
0.7404 48.6836 49.1345 0.954 0.2967 18.5786 18.6294 
0.3288 53.6456 53.6464 0.954 0.1841 21-7552 21.7456 
0.5966 8.3416 8.6809 0.954 0.5413 4.3692 4.6535 
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CR 
0.954 
0.962 
0.992 
0.986 
0.960 


0.922 
0.914 
0.996 
0.998 
0.566 


0.926 
0.940 
1.000 
1.000 
0.596 


CR 
0.934 
0.918 
0.958 
0.952 
0.826 


0.940 
0.928 
0.952 
0.974 
0.932 


0.950 
0.926 
0.966 
0.966 
0.936 
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Table 7 
Monte Carlo Simulation Results for Sampling from the SLID982 Population, Under PO Sampling Plan and the First Rule for the 
Construction of the 2,, k «U. The number of replications is set at K = 500 


n=100 n= 200 

a Estimator BRyc Vurc MSEwuic CR BRyc Vuac MSEwc CR 
C250 Oi % 0.1393 4.8403 4.8500 0.956 0.1603 2.8293 2.8493 0.922 
0, HT, a —0.0477 5.8276 5.8182 0.934 —0.0227 3.5939 3.5872 0.924 
Onn 0.1648 9.5171 OS252 0.980 0.1263 4.8687 4.8749 0.972 
0, diff, o —0.1418 4.7045 4.7152 0.960 —0.0464 2.9213 2.9176 0.936 
O, cp, « 3.9150 3.5209 18.8477 0.584 3.9114 1.9163 V7 2112 0.194 
0.5 Ovens —0.1746 8.2437 8.2577 0.944 —0.2413 3.6477 3.6986 0.940 
6, HT. —0.2824 10.1117 10.1712 0.916 —0.3343 4.5023 4.6050 0.936 
me a 0.6558 50.4938 50.8228 0.944 0.4263 26.5883 26.7169 0.948 
oF diff, o =0:5975 17.0315 17.3544 0.972 —0.3496 8.9060 9.0104 0.970 
O,, CD.a 4.3173 4.4061 23.0363 0.484 4.0937 2.0711 18.8252 0.184 
0.75 O}, ah =0:2229 12.1861 12.2114 0.942 =0:2013 6.5823 6.6138 0.952 
OF HT, a —0.4150 14.2935 14.4371] 0.934 —0.2786 7.6597 7.7220 0.934 
Op, are 0.7861 47.3844 47.9077 0.980 —0.1344 19/5992 19.5781 0.958 
any diff, o 0.4347 52.3845 52.4687 0.972 —0.3409 23.8277 23.8962 0.958 
Os CD. a 4.4114 7.7023 27.1478 0.654 4.3549 4.1566 23.1136 0.392 

Table 8 


Monte Carlo Simulation Results for Sampling from the SLID982 Population, Under PO Sampling Plan and the Second Rule for the 
Construction of the 1,, k ¢U. The Number of Replications is Set at K = 500 


n=100 n= 200 
7 Estimator BRuyc Vuuc MSEwuic CR BRywc Vuuc MSEwuc CR 
0.25 Oy cone 0.2392 3.4402 3.4906 0.962 0.1674 1.5214 1.5464 0.952 
Q,, HT, o 0.0267 4.0027 3.9954 0.940 —0.0370 1.6995 1.6975 0.958 
De ay 0.4402 7.4350 7.6139 0.970 0.1850 3.0687 3.0968 0.978 
on diff. o 0.0528 3.2842 3.2804 0.972 —0.0127 1.4718 1.4690 0.964 
OQ, cv, 0 2.1458 3.0460 7.6444 0.876 1.9785 1.3010 5.2130 0.690 
0.5 O, Gite —0.1410 6.5627 6.5695 0.942 —0.2850 2.9662 3.0415 0.954 
o,, HT, o 2133 7.6604 7.6906 0.928 —0.2876 3.6017 3.6772 0.926 
(Oe fade 1.0245 43.2773 44.2402 0.930 —0.3075 17.7242 17.7833 0.948 
O,. diff, o —0.1973 14.5261 14.5360 0.958 —0.6111 6.2988 6.6596 0.978 
O, cv, « 2.2140 4.5617 9.4543 0.834 1.8882 2.0393 5.6005 0.738 
0.75 a ae —0.1985 12.6334 12.6476 0.952 —0.0022 5.6442 5.6329 0.966 
QO, HT. « —0.4012 13.5045 13.6384 0.922 —0.1078 6.2239 6.2231 0.934 
om res 0.7968 44.0650 44.6118 0.958 0.3727 19.1830 19.2836 0.960 
O,. diff, o 0.4613 49.6620 49.7755 0.960 0.2340 22.1292 221397), 0.966 
Q,, CD. 2.6329 9.6723 16.5850 0.854 2.6729 4.1179 11.2541 0.738 
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5. Concluding Remarks 


In this paper, we have developed quantile estimators 
based on the calibration paradigm. The estimators are 
particularly easy to implement and to interpret, since they 
focus on weights and calibration constraints. Furthermore, 
they require only the population quantiles of the auxiliary 
variables, which can be vectorial. When the quadratic metric 
is adopted, analytic expressions can be obtained for 
calibrated weights as well as variance estimators, which are 
similar to those for the calibration estimator for totals. From 
a practical point of view, an appealing consequence of the 
new methodology is that the proposed estimators are easy to 
calculate; it suffices to transform the auxiliary variables and 
then use existing software to compute the calibration 
estimators. 

In a small simulation study, we compared the calibration 
estimator for quantiles, under the quadratic metric, to other 
leading quantile estimators available in the literature. The 
proposed estimator performed reasonably well in our 
empirical experiments; its performance was often preferable 
or at least similar to that of other estimators using the same 
amount of information. The model-based estimator 
incorporating much more information about the auxiliary 
variables appeared preferable under SRS sampling and a 
correctly specified model, but was outperformed by the new 
estimator when the first order inclusion probabilities were 
unequal. In general, the proposed estimator compared very 
well with the design-based alternatives of Rao et al. (1990). 

While, in this paper, we have concentrated on the 
estimation of quantiles by calibrating on known population 
quantiles for the auxiliary variables, calibration estimators 
can be extended to other important estimation problems of 
interest in survey sampling. The formulation of these 
problems all lead to different transformed variables, that we 
have noted a, in this paper. For example, it is possible to 
formulate a calibration problem for the well-known Gini 
coefficient and then show that the solution to this calibration 
problem will give weights analogous to those derived in this 
paper; however these weights can only be determined 
numerically. More work is needed in this direction, in order 
to extend calibration estimators to a more general 
framework, which would include totals, quantiles, and Gini 
coefficients as special cases. Another challenging research 
avenue concerns the choice of the distribution function 
estimator. In this paper, we have advocated a distribution 
function estimator calculated using a linear interpolation. 
Alternatively, we could consider kernel distribution function 
estimator (see e.g., Altman and Léger (1995)). Kernel 
density estimation from complex surveys is elaborated in 
Bellhouse and Stafford (1999). This means that, in 
F cal(f), the function H,, ,(¢, y,) could be replaced by a 
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general kernel, which would, however, depend on an 
additional parameter, the bandwidth. Note that the linear 
interpolation in the present paper avoids the choice of a 
bandwidth, which is often a delicate matter. Developing a 
general framework for calibration problems of a certain 
functional, and kernel distribution function estimators, are 
left for future studies. 
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A Nonresponse Model Approach to Inference Under Imputation 
for Missing Survey Data 


David Haziza and Jon N.K. Rao ' 


Abstract 


In the presence of item nonreponse, two approaches have been traditionally used to make inference on parameters of 
interest. The first approach assumes uniform response within imputation cells whereas the second approach assumes 
ignorable response but make use of a model on the variable of interest as the basis for inference. In this paper, we propose a 
third appoach that assumes a specified ignorable response mechanism without having to specify a model on the variable of 
interest. In this case, we show how to obtain imputed values which lead to estimators of a total that are approximately 
unbiased under the proposed approach as well as the second approach. Variance estimators of the imputed estimators that 
are approximately unbiased are also obtained using an approach of Fay (1991) in which the order of sampling and response 
is reversed. Finally, simulation studies are conducted to investigate the finite sample performance of the methods in terms 


of bias and mean square error. 


Key Words: Bias-adjusted estimator; Deterministic regression imputation; Imputation model approach; Item 
nonresponse; Nonresponse model approach; Random regression imputation; Variance estimation. 


1. Introduction 


Item nonresponse occurs in a survey when a sampled 
element participates in the survey but fails to provide 
responses on one or more of the survey items (Brick and 
Kalton 1996). It is usually handled by some form of 
imputation which involves “filling in” missing values for 
each item. Imputation may achieve an effective bias 
reduction, provided suitable auxiliary information is 
available for all the sampled elements and appropriately 
incorporated in the imputation model and/or the non- 
response model. 

Imputation offers the following desirable features, among 
others: (1) it leads to the creation of a complete data file, and 
(11) it permits the use of the same survey weights for all 
items which ensures that the results obtained from different 
analyses of the completed data set are consistent with one 
another, unlike the results of analyses from an incomplete 
data set. However, imputation also presents the following 
difficulties, among others: (a) marginal imputation for each 
item distorts the relationship between items, and (b) treating 
the imputed values as if they were true values may lead to 
serious underestimation of the variance of imputed esti- 
mators, especially when the nonresponse rate is appreciable. 
Methods that address (a) and (b) have been proposed in the 
literature. 

In this paper, we focus on marginal imputation that is 
commonly used in many surveys. We first consider deter- 
ministic linear regression imputation that includes mean and 
ratio imputation as special cases. In this method a missing 
value is replaced by the predicted value obtained by fitting a 


linear regression model using respondent values and 
auxiliary variables collected on all the sampled elements. 
We also consider the case of random linear regression 
imputation that may be viewed as a deterministic regression 
imputation plus an added random residual. It includes 
random hot-deck imputation as a special case. 

Let U bea finite population of possibly unknown size N. 
The objective is to estimate the population total Y = >, y, 
of an item y when imputation has been used to compensate 
for nonresponse on the item values y,. For brevity, > , 
will be used for >),.,, where A <U. Suppose a probability 
sample, s, of size n is selected according to a specified 
design p(s) from U. Under complete response to item y, a 
design-unbiased estimator of Y is given by the well-known 
Horvitz-Thompson estimator 


= DE ys (1) 


with sampling (or design) weights w,=1/7,, where 1, 
denotes the inclusion probability of population unit i in the 
sample s,i=1,..., NV. Rao (2005) suggested that (1) should 
be called the Narain-Horvitz-Thompson (NHT) estimator in 
recognition of the fact that Narain (1951) also discovered 
(1) independently of Horvitz and Thompson (1952). 

In the presence of nonresponse to item y, we use impu- 
tation and define an imputed estimator Y, as 


Ne =) way, +> wl-a)y, => wy, (2) 


where y, denotes the value imputed for missing y,, a, 
denotes the response indicator equal to | if unit 7 responds to 
item y and 0 otherwise and ¥, =a,y,+(l—a,)y,. The 


1. David Haziza, Business Survey Methods Division, Statistics Canada, Ottawa, Ontario, Canada, K1A 0T6; J.N.K. Rao, School of Mathematics and 


Statistics, Carleton University, Ottawa, Ontario, Canada. K1S SB6. 


54 Haziza and Rao: A Nonresponse Model Approach to Inference Under Imputation for Missing Survey Data 


imputed estimator (2) can be implemented from the imputed 
data file containing the survey weights w, and the y, only, 
without the knowledge of response indicators a,. However, 
the response indicators will be required for variance esti- 
mation. Let p, = P(a,=1) be the item y response proba- 
bility for unit 7. In this paper, we assume that the units 
respond independently of one another, ie, pj, = 
P(a, =1,a, =1)= p,p, if i 4 j. 

As for any method of compensating for missing data, 
imputation requires some assumptions about the response 
mechanism and/or the imputation model. In the presence of 
imputed data, two different approaches are generally used 
for making inference on totals, means and other parameters 
of interest: (1) Imputation model (IM) approach; (11) Non- 
response Model (NM) approach. Approach (1) is also called 
model-assisted approach (Sarndal 1992) and approach (11) 
design-based approach (Shao and Steel 1999). NM 
approach is based on partitioning the population U into J 
imputation cells and then imputing nonrespondents 
y—values within each cell using respondent y—values within 
the same cell as donor values, independently across the J 
cells. The following assumption is made: 


Assumption NM: Response probability for a given item 
of interest is constant within imputation cells. That is, 
PD; = P,, Say, where the subscript v denotes the imputation 
cell. 

In the NM approach, explicit assumptions about the 
response mechanism are made. It follows that inference 
under assumption NM is with respect to repeated sampling 
and uniform response mechanism within cells. Approach 
NM has been studied by Rao (1990, 1996), Rao and Shao 
(1992), Rao and Sitter (1995) and Shao and Steel (1999), 
among others. For simplicity, we assume a single impu- 
tation cell so that p, = p under assumption NM. 

IM approach is based on the following assumption: 


Assumption IM: Item values are missing at random 
(MAR) in the sense that the response probability does not 
depend on the item value being imputed but may depend on 
auxiliary variables used for imputation. Further, a model 
that generates the item values y. is assumed. 

In the IM approach, explicit assumptions about the 
distribution of item values y, is made through a model 
called the “imputation model’. It follows that inference 
under assumption IM is with respect to repeated sampling 
and the assumed model that generates the finite population 
of y—values and nonrespondents to item y. Underlying 
response mechanism is not specified, except for the MAR 
assumption, unlike in the NM approach. The assumed 
response mechanism under assumption IM is much weaker 
than the uniform response within cells under assumption 
NM, but inferences under assumption IM depends on the 
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assumed population model. IM approach has been studied 
by Sarndal (1992), Deville and Sarndal (1994) and Shao and 
Steel (1999), among others. 

Under linear regression imputation, IM approach 
assumes the following linear regression imputation model: 


En.) = Zi; V,.V) =; = ath 2), 
Cov, (¥j,¥;) = 0 if i J, (3) 


where y is A-vector of unknown parameters, z, is a A-vector 
of auxiliary variables available for all ies, is a A-vector 
of specified constants, 6” is an unknown parameter and 
EV, and Cov,, denote respectively the expectation, the 
variance and the covariance operators with respect to the 
imputation model. The restriction o; =o°(4'z,) does not 
severely restrict the range of imputation models. 

In this paper, we propose a third approach, called the 
Generalized Nonresponse Model (GNM) approach. GNM 


approach is based on the following assumption: 


Assumption GNM: Item values are missing at random 
(MAR) and response probability is specified as a function of 
auxiliary variables, u,, observed on all the sample 
elements, and unknown parameters 1. 

In this paper, we assume that the probability of response, 
p;, for unit i, is linked to an /-vector of auxiliary variables 
u,; according to a logistic model so that 


Pp; = f(a; n) =exp(u;n)/exp(l+ujn), — (4) 


where 9 1s the /-vector of model parameters. Model (4) is 
the assumed nonresponse model. It can be validated from 
the values a, and u, for ies. Note that a, and u, are 
item specific. Also, note that assumption NM is a special 
case of assumption GNM. As in NM approach, explicit 
assumptions about the response mechanism are made and 
inference under assumption GNM is with respect to 
repeated sampling and the assumed response mechanism. 
Recall that imputation is designed to reduce the non- 
response bias, assuming that the available auxiliary 
variables can explain the item to be imputed and/or the item 
response probability. Hence, in practice, the choice of the 
approach (IM or GNM) should be dictated by the quality of 
the imputation model and the nonresponse model. The 
choice between modeling the item response probability and 
modeling the item of interest will depend on how much 
reliance one is ready to place on the two models. Although 
it may seem intuitively more appealing to model the item of 
interest, there are some cases encountered in practice for 
which it may be easier to model the response probability 
(GNM approach). For example, the Capital Expenditures 
Survey at Statistics Canada produces data on investment 
made in Canada, in all types of Canadian industries. For this 
survey, two important variables of interest are capital 
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expenditures on new construction (CC) and capital 
expenditures on new machinery and new equipment (CM). 
In a given year, a large number of businesses have not 
invested any amount of money on new construction or new 
machinery. As a result, the sample data file contains a large 
number of zeros for the two variables CC and CM. In this 
case, modeling the variables of intrest (CC or CM) may 
prove to be difficult. 

Survey design weights are generally used in linear 
regression imputation. The resulting imputed estimator of a 
population total is “robust” in the sense that it is 
approximately unbiased under either assumption NM or 
assumption IM. However, the imputed estimator is 
generally biased under assumption GNM. In this paper, we 
propose a new method of linear regression imputation that is 
robust in the sense of leading to approximately unbiased 
estimators under either assumption GNM or assumption IM. 

Section 2 develops a new method of deterministic linear 
regression imputation as well as random linear regression 
imputation, and demonstrates the robustness property in 
estimating a population total Y. Results of a simulation study 
on the finite-sample performance of the imputed estimator 
under the new method of imputation are reported in 
section 3. Variance estimators are derived in section 4, using 
the ‘reverse’ approach of Fay (1991) in which the order of 
sampling and response is reversed: 


Population — census with nonrespondents — sample 
with nonrespondents. 


Simulation results on variance estimators are also given. 
Finally, the case of domain means is investigated in 
section 5. 


2. Estimation of a Total 


In this section, we study the bias of the imputed estimator 
Y,. The total error, Y, - Y, may be decomposed as 


Y,-Y =(Y-Y)+(¥,-Y). (5) 


The term Y—Y in (5) is called the sampling error, 
whereas the term Y,—Y is called the nonresponse/ 
imputation error. Note that there is no imputation error 
under deterministic imputation. Since the sampling error 
does not depend on nonresponse and imputation method, we 
focus on the nonresponse/imputation error ¢ ~Y and 
evaluate its properties conditionally on the sample s. Under 
the NM or GNM approach, the conditional nonresponse 
bias is defined as PAY, —~Y|s), where E..(.) denotes the 
expectation with respect to the response mechanism. Under 
the IM approach, the conditional nonresponse bias is 


defined as E.E,(Y, —Y|s) under MAR assumption. 
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2.1 Deterministic Regression Imputation 


Deterministic regression imputation uses the imputed 
values 


y; =i%, (6) 


for missing y,, where 
-1 
1, = > WAZ ;Z; (aa)) e wiajZ,y;(NZ,) (7) 


is the weighted least squares estimator of y in the model 
(3), based on the sample elements responding to item y. 
Using (6), the imputed estimator (2) can be written as 

¥,=¥,+(Z-Z,)'%,, (8) 
where Y =>. w.a,y,,Z=>,.w.z, and Z.=).. w,a,zZ,. 
Note that the imputed estimator (8) is similar to a regression 
estimator in the case of two-phase sampling. 

Under assumption NM, £,(a,|s)=p and the condi- 
tional nonresponse bias, E,(Y,—Y|s), is approximately 
equal to 0. Furthermore, under assumption IM and 
regression model (3), the conditional nonresponse bias 
E.E(Y,—Y|s), is equal to 0. However, under assumption 
GNM, the conditional nonresponse bias is given by 

E,(¥,-¥|s)*—-¥) wi - py -247,) = BM |), O) 


Ss 


where 
=4 
we B W; DLL; (an) De W; PZ Y; (Z;). (10) 


This result follows from the fact that under assumption 
GNM, E..(a;|s) = p;. Hence, the choice of imputed values 
(6) is, in general, not suitable under assumption GNM. For 
the special case of assumption NM with p, = p, the last 
term in (9) vanishes, noting that (2, w,Z))Y, = 
(dX, WZ; 2; (XZ) p = (a Zev (hE: =D. Vay. 
2.2 A Bias-Adjusted Estimator 


We assume for now that the response probabilities p, 
are known. A natural approach for eliminating the bias of 
Y, under assumption GNM is to consider a bias-adjusted 
estimator of the form 


VY =Y,—B(,|5), (11) 
where BUY, |x) is an estimator of B(Y, is) 


y #5 pes ; 
ial ice wa PO (y, ie aca) 


Note that E [B(Y, |s)|s]* BU, |s) under assumption 
GNM. Substituting (12) in (11), we get a bias-adjusted 
estimator as 


ff =E Mow [5 W;Zi- >, math, (13) 


S 1 RY 1 
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Note that (13) is also in the form of a two phase regression 
estimator. 

In practice, response probabilities p, are unknown. 
Suppose we can obtain estimators p, of p, by modelling 
p, according to the nonresponse model (4). Then, a bias- 
adjusted estimator is obtained by replacing p, in (13) with 
p;. This estimator is also approximately conditionally 
unbiased under assumption IM. Hence, the bias-adjusted 
estimator (13) is robust in the sense of validity under either 
assumption IM or assumption GNM. However, unlike the 
imputed estimator Y, given by (2), the bias-adjusted 
estimator Y,“ cannot be computed without the knowledge of 
the response identifiers, a,, and the estimated response 
probabilities, p,. Hence, both the response indicators and 
the estimated response probabilities must be provided with 
the imputed data file to implement Y,’, which may not be 
the case in practice. This drawback of Y,“ can be eliminated 
by using the new imputation method, given in section 2.3, 
that leads to an approximately unbiased estimator under 
either assumption GNM or assumption IM without the 
knowledge of a, and p, onthe imputed data file. However, 
for variance estimation, access to a; and p, is needed. 


2.3. Modified Deterministic Regression Imputation 


We assume for now that the response probabilites p, are 
known. We then use the imputed values 
y, = 2%, (14) 
for missing y, and obtain the form of y, that leads to an 
approximately unbiased estimator under assumption GNM. 


2.3.1 Approximately Unbiased Estimator 


The following lemma gives the form of 7, that leads to 
an approximately unbiased estimator under assumption 
GNM. 


Lemma 1: Under assumption GNM, the choice of ¥, that 
leads to E.(Y,-Y|s)=0 is given by 


= 
Ys = b w,(1— p;)zZ,Z;/('Z; ) 


Dd. will = p;)B; ¥; (0'2;). (15) 
Proof: The conditional nonresponse bias of Y, with 
y, =z!¥, under assumption GNM is given by 
E,(¥; -¥|s)=-)) wi— v0, - 2170) 
Noting that (A’z,)/(\’z,)=1, _ it 
EGF ls)=0i if ¥, satisiies 


follows that 


A/D w;(1— p;)Z, 0; 17,)10:2) = 02 aA 16) 


Ss 
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The choice ¥, = ¥, y Satisfies (16). 

Note that Y, , 1s unknown since the y—values are only 
observed for ies, and the response probabilities p, are 
unknown. An estimator of Y, ,, based on the responding 
units and estimated response probabilites p,, is given by 


(Lp) 
seals 5 


l 


—| 


Z;Z; (a'n)| 


Y 4,4, Pg, yin) (17) 
s P; 
We have E,(y¥,|5)*¥, 7 so that Y, is conditionally 
approximately unbiased for Y, , under assumption GNM. 
Hence, using the imputed values 

y =U, (18) 
in (2) with ¥, given by (17), leads to an approximately 
unbiased estimator of the total Y under assumption GNM. 
Note that 7, is a weighted least square estimator of y with 
respect to a new set of weights, w,/(A'z,), where 
w,=w,((1— p,)/p,). Hence, the procedure increases the 
weights w, for those units with p, <1/2 and decreases the 
weights for those units with p,>1/2. The imputed 
estimator can be implemented from the imputed data file 
containing the sampling weights w, and the y, only; 
response identifiers a, and estimated response probabilities, 
p;, are not required. However, a, and p, are needed for 
variance estimation. Note that the producer of the imputed 
data file uses the information on a, and u, to fit the 
response model (4) and generate the imputed values y, 
given by (18). 

The use of imputed values (18) also leads to an 
approximately unbiased estimator of Y under assumption 
IM. First, under the regression model (3), noting that 
E,,(y,|s)=z;y and E,(¥,|s)=y, we have E(Y,- 
Y\|s)=0 and E.E,(Y, —Y|s)=0 without specifying the 
underlying MAR response mechanism. Hence, the use of 
imputed values (18) leads to a robust imputed estimator in 
the sense of validity under both approaches. Finally, it is 
interesting to note that the imputed values (18) can also be 
obtained using the method of calibration imputation 
(Beaumont 2005). Calibration imputation consists of finding 
final imputed values as close as possible to original imputed 
values according to some distance function, subject to the 
calibration constraint. 

Two particular cases of modified regression imputation 
(18) are of interest: (1) modified ratio imputation with 
Z, =z, and d’z, =z,; (il) modified mean imputation with 
z,=1 and 2’z,; =1. In case (i), the imputed values (18) 


reduce to 


Y; RAY wines (19) 
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In case (ii), the imputed values (18) reduce to 
line (20) 


Under uniform response p, = p, the imputed values (19) 
and (20) reduce to (2, wa,y,/d., w,a,z;)z, and y, = 
X, w,a,y,; / Xu, w,a; respectively, which are the usual values 
that survey practioners use for ratio and mean imputation 


(Rao and Sitter 1995). 
2.3.2 Optimal Choice of 7, 


We now turn to the “optimal” choice of Y, by mini- 
mizing the conditional mean square error of the imputed 
estimator Y, with y, = z{¥,. The conditional mean square 
error of the imputed estimator y is given by 


MSE, (Y, |s) =V,(Y, | s) + [Bias(Y, | s)P 
=> wpe p\Q,-2:79,). 


DD wl PO, - #9.) (21) 


where V,(.|s) denotes the conditional nonresponse 
variance with respect to the response mechanism, given the 
sample s. We search for y, that minimizes MSE,(Y, |s). 

The optimal choice, ¥,,, of ¥, 1s complex, but in the 
special case of ratio imputation, Y,,, reduces to 


» (=p) >, wid- pz; +>) wi; Pil- pi) Viz; 


: "Q2) 
[Em pds] +, snp 


Yopt = 


Assume that the sampling weights w, satisfy max(n/ 
Nw,) = O(1) and that a positive constant C exists such that 
C7) hen, 


Y opt ro 


oe w,(1— p;) 9; of | 
We w, (1 — p;)zZ; 


= Lan - of *} 
nN 


Hence, for large sample sizes, the choice y, , 1s nearly 
optimal for ratio imputation. Similarly, y,, is nearly 
optimal for mean imputation which is a special case of ratio 
imputation. 


2.4 Random Regression Imputation 


Random imputation can be viewed as deterministic 
imputation plus a random noise. Let s, and s,, denote the 
sets of sample respondents and nonrespondents respectively, 
and let e,=(y,-zf,)/(d'z,)"” be the standardized 
residuals for the respondents j¢€s, under deterministic 


a7 


regression imputation. Further, e, =e, with P(épse j= 
w,/., w,a, independently for each ie s,,. Then, random 
regression imputation uses the imputed values y, = 
zif, +€,,i€8,, where e, =(4'z,)'(e, -@) with @ = 
2X, wjaje;/ 2, w,a;. Let E,(.) denote the expectation with 
respect to the random imputation process. We have 
Biles =0 and Bas) equals (8). Hence, the imputed 
estimator Y, is approximately unbiased under either 
assumption NM or assumption IM. It may be noted that 
random regression imputation covers random (weighted) 
hot-deck imputation as a special case. To see this, consider 
the mean imputation model E,,(y,)=7,V,,(y;)=0° and 
Cov,,(¥;,¥;)=0,i# j. We have 7, =2, wiaj,y,/ 
x, w,a;=y,, the weighted mean of the respondent y— 
values, and e,=y,—y,. Therefore, es ee j 
corresponds to the respondent value y, drawn at random 
with probability w,/ 2, w,q;. 

The imputed estimator based on random regression 
imputation is asymptotically biased under assumption 
GNM. To obtain an approximately unbiased estimator for Y, 
we propose modified random regression imputation. Let 
&,=(y;-2;¥,)/('z,)"” and & =2, with P(e =2,) = 
w,/2, w,a, independently for each ies,,, where Y, is 
given by (17) and w,=w,(-p,)/p;. Then, modified 
random regression imputation uses the imputed values 
y, =Z\¥,+€, where é =(0'z,)'"(€ -&) with & = 
2, waje,/L,wa, We have Even) 0 and £,(Y,) 
equals the imputed estimator under modified deterministic 
regression imputation. Hence, the imputed estimator Y, is 
approximately unbised under either assumption GNM or 
assumption IM. For the special case of mean imputation 
model, we have ¥,= >, W,a,y,/L,W,a, and y;=y, 
corresponds to the respondent value y, drawn at random 
with probability w,/2., W,q;. 


3. Simulation Studies 


We performed two simulation studies to investigate the 
finite sample performance of the proposed deterministic 
modified regression and modified random regression impu- 
tation methods in terms of relative bias and relative root 
mean square error. The first simulation study compares the 
performance of the traditional deterministic regression 
imputation and the proposed modified deterministic regres- 
sion imputation when the imputation model and/or the non- 
response model are not correctly specified. The second 
simulation study compares the performance of the imputed 
estimator obtained by using imputation classes based on the 
estimated response probabilities and weighted mean impu- 
tation (traditional) with the imputed estimator obtained by 
using the proposed modified deterministic regression impu- 
tation method. 


Statistics Canada, Catalogue No. 12-001-XPB 


58 Haziza and Rao: A Nonresponse Model Approach to Inference Under Imputation for Missing Survey Data 


3.1 Simulation Study 1 


We generated a finite population of size N =1,000 
containing 3 variables: a variable of interest y and two 
auxiliary variables z, and z,. To do so, we first generated 
z, and z, independently from an exponential distribution 
with mean 4 and 30 respectively. Then the y—values were 
generated according to the regression model 


Vi = Vo + V141i + 222; + > 


where the e,’s are generated from a normal distribution 
with mean 0 and variance o*. The values of the parameters 
Yo,Y, and y, were respectively set to 20, 2 and 0.1 and the 
variance o” was chosen to lead to a model R* —value 
approximately equal to 0.75. The objective is to estimate the 
population total Y = 2, y,. 

We generated R=5,000 simple random samples with- 
out replacement of size n =100 from the finite population. 
In each sample, nonresponse to item y was generated 
according to the following response mechanisms: 


Mechanism 1: Response probability p,, for unit 7 is given 
by the logistic regression model 


Pri 


log = Np FAIZ: 
Pri 
Mechanism 2: Response probability p,, for unit i is given 


by the logistic regression model 


Pj 


log =o +X, Y;- 
2i 

The values of A, and A, were chosen to give an overall 
response rate approximately equal to 70%. The response 
indicators a,; and a,, were generated independently from a 
Bernoulli distribution with parameters p,; and p,,, 
respectively. Note that in the case of the nonresponse 
mechanism 2, the response mechanism is nonignorable in 
the sense that the probability of response depends on the 
variable of interest y. 

To compensate for the nonresponse to item y, we used 
the traditional deterministic regression imputation for which 
the imputed values are given by (6) and the modified 
deterministic regression imputation for which the imputed 
values are given by (18). Imputations were based on the 
models for y and for p listed in Table 1 as yy), Vi), 
Vay» Yay ANd Pay, Per), Peay. Note that p,) corresponds to 
response mechanism | and j,,) to the model generating the 
population. 

From each simulated sample, we calculated the imputed 
estimator Y, given by (2) with the imputed values (6) and 
(18), based on selected combinations of the models yy. and 
Peyid=l...,4,b= l, 2,3. As a measure of the bias of an 
imputed estimator Y,, we used the percent simulated 
relative bias (RB) given by 
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RB(Y,) = ee x 100, (23) 
where 
ae ee LS ye 
Bias(¥,) => DY, —Y (24) 
r=1 


and Y;”) denotes the value of Y, for the r-th simulated 
sample. As a measure of variability of an imputed estimator 
Y,, we used the percent simulated relative root mean square 
error (RRMSE) given by 


i? SIMSEGS 
RRMSE(/, ) pape ee 100, (25) 
where 
oy 1< > (r) 2 
MSE (F,)== 9) @)? -¥)". (26) 
r=l 
Table 1 
Models Used for Imputation 
Models for y Intercept Z; 2 
Yay Yes Yes “Yes 
Y(2) Yes Now. Yes 
VQ) Yes Mess INo 
Y(4) No Sesmeyes 
Models for p; Intercept Zi ant 2 
Pay Yes Yes «No 
P2) Yes No Yes 
Po) No Yes.. No 


Results on relative bias and RRMSE are shown in Table 
2 for the the samples generated by reponse mechanism 1 
and in Table 3 for the samples generated by the response 
mechanism 2. From Table 2, it is clear that, when the 
imputation is performed according to the correct model (Z.e., 
Yqy), traditional deterministic regression imputation leads 
to an approximately unbiased estimator and it is more 
efficient than the modified deterministic regression impu- 
tation in terms of RRMSE. As noted by a referee, modified 
deterministic regression imputation can lead to more 
efficient estimators than traditional deterministic regression. 
That is, there are scenarios (not considered here) for which 
the proposed modified deterministic regression imputation 
method may be more efficient than the traditional deter- 
ministic regression imputation method. 

When the imputation model is incorrectly specified (e.g., 
Ya) and y,4)), deterministic imputation leads to biased 
estimators whereas the bias of the modified determinisic 
imputation is small to negligible, provided the nonresponse 
model is correctly specified (i.2., p,,)). As a result, RRMSE 
for the deterministic imputation is larger than that for the 


Survey Methodology, June 2006 


modified deterministic regression imputation. When both 
imputation and nonresponse models are not correctly 
specified (¢.2., (4) — Pi), all the estimators are biased. 

From Table 3, it is clear that, for the case of mechanism 
2, the imputed estimator obtained under modified regression 
imputation performs equally or better than the imputed 
estimator obtained under traditional regression imputation in 
all the scenarios. This result is not suprising since achieving 
an effective bias reduction in the case of nonignorable 
nonresponse requires the use of all the appropriate auxiliary 
information available. The auxiliary information used in the 
case of the proposed modified regression imputation is 
richer than the one used in the case of regression imputation 
since it uses the auxiliary variables that are related to both 
the variable of interest y and the response probability 
whereas regression imputation uses only the auxiliary 
variables related to the variable of interest y. 


Table 2 
Relative Bias (“%) and RRMSE (%) of Imputed Estimators 
Under Response Mechanism 1 


Scenario Bias Bias RRMSE RRMSE 

(traditional) (proposed) (traditional) _ (proposed) 
ya) — Pa) 0.19 —0.01 1.85 239 
Y(2) ~ Pa) 5.20 0.16 5.60 2.66 
¥@) — Pa) 0.17 —0.04 1.87 pre if| 
¥(4) — Pa) —14.80 asl 15.00 6.70 
Ya) — PE) 0.19 0.12 1.85 1.86 
(4) — P2) —14.80 —14.80 15.00 14.60 
Yl) — Pe) 0.19 0.05 1.85 1.88 

Table 3 


Relative Bias (%) and RRMSE (%) of Imputed Estimators 
Under Response Mechanism 2 


Scenario Bias Bias RRMSE RRMSE 
traditional) (proposed) (traditional) (proposed) _ 
Y(t) — PQ) 1.84 1.83 2.55 2.54 
y2) — Pay 4.46 1.84 4.89 2.65 
YQ) — Pay 2.03 2.02 2.70 2.70 
¥(4) — Pay —4.58 —3.04 5.07 3.81 
Ya) — P2) 1.84 1.84 2.55 2.55 
¥(4) — P(2) —4,58 —1.70 5.07 2.88 
Yd) — PB) 1.84 1.84 255 255 


3.2 Simulation Study 2 


We generated a finite population of size N =1,000 
containing 3 variables: a variable of interest y and three 
auxiliary variables z,,z, and z,, by first generating z,, z, 
and z, independently from an exponential distribution with 
mean 100 and then generating the y—values according to the 
regression model 


2 
Vi =Vo + Vii + 222; + 341i + E> 
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where the e€,’s are generated from a normal distribution 
with mean 0 and variance o*. The values of the parameters 
Yo. V1» Y> and y, were respectively fixed to 20, 10, 0.5 and 
10. The variance o* was chosen to lead to a model R’ 
approximately equal to 0.66. The objective is to estimate the 
population mean Y =>,, y,/N. In order to focus on the 
nonresponse/imputation error, we considered the case of a 
census, i.e., n= N =1,000. From the simulated population, 
nonresponse to item y was generated according to the 
following response mechanisms: 


Mechanism 1: Response probability p,; for unit i is given 
by the logistic model 


Pri 


log sar © noni tes eamed OA Bee 


Pj 
Mechanism 2: Response probability p,; for unit 7 is given 
by the logistic model 


a hg FAY; +923): 

7 Pa; 
The values of 1,4, and A, were chosen to give an overall 
response rate approximately equal to 70%. Response 
indicators a,, and a,, were then genrated independently 
R=1,000 times from a Bernoulli distribution with para- 
meters p,, and p,,, respectively. 

To compensate for nonresponse, two strategies were 
used: The first strategy consisted in dividing the sample, s, 
into imputation classes s,,55,...,5¢ based on the auxiliary 
variables z,,z, and z,. To form the classes, we used the 
score method which may be described as follows: Using the 
auxiliary information, we first estimated the response 
probabilites, p,, to obtain p, for both the respondents and 
the nonrespondents using logistic regression on z,,z, and 
z,. Using the p; ’s, we then partitioned the population into 
C classes using the procedure FASTCLUS of SAS (that 
uses the k-means classification algorithm). The score 
method leads to a partition of the population in such a way 
that, within classes, units (respondents and nonrespondents) 
are homogeneous with respect to p,—values. The second 
strategy used the proposed modified regression imputation 
method based on the auxiliary variables z,,z, and z,. The 
goal of the simulation study is to compare the performances 
of two imputed estimators of the population mean Y: (a) 
Imputed estimator based on the C imputation classes: 


ce & NL 
Oy =>) We (27) 


log 


where 


l « 
Vie ar bs W;9; Yj +>) w,(1—a;)y; |, 


€ 


and N.=>, w,. We used weighted mean imputation 
within classes; i.e., y; = 2, w,a,y;/L, wja;. 
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(b) Imputed estimator based on the proposed modified 
regression imputation, denoted y, : 


b as ome w; (1 -ayyi (28) 


where the imputed values y, are given by (18) using 
z =(z,,,Z,,)' and N=)>,w,. For mechanism 1, the 
response probabilities p, were correctly estimated using the 
variable z, and z, whereas the variables z,,z, and z, 
were used to estimate p, for mechanism 2. 

Note that w, =1 in this simulation study for all 1¢U 
because no sampling is involved. Finally, Table 4 compares 
these estimators in terms of relative bias, given by (23) and 
RRMSE, given by (25). From Table 4, it is clear that the 
proposed imputed estimator (28) performs considerably 
better than the estimator (27) based on imputation classes in 
terms of RRMSE for both mechanism | and mechanism 2. 


ie | 
a 


Table 4 

Relative Bias (%) and RRMSE (%) of Imputed Estimators 
Imputed estimator* Number ofclasses RB | RRMSE- 

yy (mechanism 1) I 144 14.5 

5 —0.02 4.26 

10 —0.85 WB 

20 =():20 8.61 

30 —0.03 8.61 

40 0.03 9.09 

50 0.06 9.44 

y, (mechanism 1) = ii 1.90 

3° (mechanism 2) 1 290 29.1 

5 21.4 21.4 

10 21.0 Pike 

20 20.9 21.0 

30 20.9 21.0 

40 21.0 21.0 

50 21.0 FAG 

y, (mechanism 2) = 10.9 10.9 


* >F given by (27) and 7, given by (28). 


4. Variance Estimation 


In this section, we derive a variance estimator of the 
imputed estimator Y, 7, using the reverse approach of Fay 
(1991). The total variance of Y , under a_ particular 
deterministic imputation method, is given by 

V(Y,-Y)=E,V,(¥,-Y|a)+V,E,(¥,-Y\a), (29) 
where a =(a,,...,@,)’ is the vector of response indicators, 
(Shao and Steel 1999). An estimator of the overall variance 
V(Y, —Y) in (29) is given by v, = v, +v,, Where v, is an 
estimator of VAY, —Yja) conditional on the response 
indicators a,, and v, is an estimator of V,[E,,(Y, — Y |a)]. 
The estimator v, does not depend on the response 
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mechanism or the imputation model, and hence v, 1s valid 
under either assumption GNM or assumption IM. 

Under the corresponding random imputation, the 
variance of the imputed estimator Y, is given by 


V(Y,-Y)=E,V, E.(Y, -Y|a)+E, E,V.(Y, -Y |a) 
+V,E, E.(Y,-Y|a), (30) 


where /,(.) denotes the variance operator with respect to 
random imputation. We assume that E.(Y,|a) agrees with 
the imputed estimator for the deterministic case. Hence, 
EV ,EAY, ie 1 ads estimated by v, for the deterministic 
case. Similarly, V.E,E.(Y, —Y|a) is estimated by v, for 
the deterministic case. The additional contribution to 
variance due to random imputation comes from the 
component ELE Oe —Y|a), which is estimated by 
v. =V,(Y, -Y|a). Hence, it follows from (30) that the 
overall variance V(Y, — Y) is estimated by v, = v, + v. + Vp. 
The term v, is absent for deterministic imputation. 


4.1 Known p, 


In this section, we assume that the reponse probabilites 
p; are known. We first consider the case of modified 
deterministic regression imputation in section 4.1.1. The 
case of modified random regression imputation is studied in 
section 4.1.2. 


4.1.1 Modified Deterministic Regression Imputation 


Under modified deterministic regression imputation, the 
imputed estimator with known p, may be written as 


li, =) Wii); +(Z-Z,)' V9, (31) 


where 


AY } 


-| 
aie bs pe nw on) 


AY L 


b wa, HSPs) a% ZY; ca'n)| (32) 


To obtain v,, we use standard Taylor linearization which 
leads to 


Pp —k-~ >. Wie, (33) 
where 


ae — Oy: 7G. )2, 7, 
2 aspen 
Dix doy) 


Zi (9; OLY one) 


with eas wa; ((1— p;)/ p;)z,zZ; (’z;). Denoting the 
variance estimator of the full sample estimator as 
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Y=y, w,y, as v(y), it follows from (33) that an estimator 
of V,,(Y, —Y |a) is given by ¥ 

vy =v(§,), (34) 
which is obtained by replacing y, by ae in the formula for 


v(y). 
To obtain the second component v,, first note that 


E,(¥,, -Y|a)~ >) ay,+ > d-a)y,-Y, 
Ss U 


where 
aa 


t 
l= p, a) 
Ne dic =P '0°2)} ws Pia 910°). 


i 


i 


Using Taylor linearization, it can be shown that 


VLE, -Ylal~ > p,-p)C;, (35) 
U 
where 
vi (l= p,) te trl a: 
Ci -|1 a Giz) Z,) a 2 |o ZiY p) 


with Z=2) 2;,,Z, =X y az, and T,=2dy a,((1-p,)/p;) 
Z,Z;,/(X'z,). The component v, is then obtained by esti- 
mating the unknown quantities in (35), which leads to 


Voc; » w,a;(1—- DG» (36) 


where 
del leas 
p, (WZ;) 
An estimator of the total variance v, is obtained as the sum 
of (34) and (36): v,=v,+v,. In practice, the response 
probabilities are unknown. As a result, it is not possible to 
calculate the variance estimator v,. A simple solution 
consists in replacing p, by the estimated response proba- 
bilities p, in (34) and (36) and use the resulting v, as the 
variance estimator of Y,. As we show ina simulation sudy 
in section 4.3, this simple method gives acceptable results. 


(Zi Lat a7, (Vt ZY): 


4.1.2 Modified Random Regression Imputation 


We first note that 
V.(y;) = 
hese 28 wet sored = 7) 4 
(A'z,) >) w, i a,(é, -é,)° i F 
s P; s P; 
and Car = 0 Hence. trom (2): the 


component v., due to random imputation, is given by 
ve = > we (1-4, V(9;) = > we l-a,)s?. 37) 


An estimator of the total variance is obtained as the sum of 
(34), (36) and (37): v, =v, + v, + vs. Once again, since the 
response probabilities p, are unknown, it is not possible to 
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compute v, in (37). We propose to replace p, in (37) by 
the estimated response probabilities ),. 


4.2. Unknown p, 


We use Binder’s method (Binder 1983) to derive the 
component v, when the response probabilities p, are esti- 
mated. We assume that p, = f(u,;n), where n is |-vector 
of unknown parameters, u, is a |-vector of auxiliary vari- 
ables available for all ics. For example, in the case of 
logistic regression, f(u;n) = exp(u;)/exp(1+ujn). The 
estimated response probabilities are given by p, = f(u; 1), 
where f is a consistent estimator of n. Let @= 
(Nv.Yv>Y), where n, and y, are census parameter 
corresponding to n and y, respectively. An estimator of 6 
given by 6 = (4, 7, Y,)' can be expressed as a solution of 
the sample estimating equations 


S(0) = 0, 
where $(0) =($,(0),$,(0), 5,(@)) with 


S, (6) = Ss w,u,la, — fu; Ny )] = 9, 


= fuiny)) 


S,(0) = her ee 5 ,— Zs (V'Z;) =0 
2 (9) jase can (V; -—Zi¥n (AZ 


and 
S,(0) = i -»> WZ. y -»> way; -Z;Yy)=0. 


Let J(0)=(0S(@)/00) be the (k+/+1)x(k+/+1) 
matrix of partial derivative. We have 


V(6) =[J-'(0)]X (8) [J *(6)], 


where >)(8) denotes the (k+/+1)x(k+/+1) symetric 
matrix whose ij element is the covariance between S,(@) 
and S ;(9) with respect to sampling given the vector of 
response indicator a. If (0) is replaced by a consistent 
estimator > (6), say, we obtain a consistent variance 
estimator v(6) given by 


v(6) =[JF-' (6)] (6)[F" )Y’. 
Since we are interested in the variance estimator, v,, of 


[? 
we need the final row, b, say, of J'(8), evaluated at 6 = 0. 
It follows that 


v, = bd(6)b’. (38) 


To obtain the component v,, we assume that the 
sampling weights w, satisfy max(n/ Nw,)=O(1) and that 
there exists a positive constant C such that C< p,. 
Furthermore, we assume that j — 9 = OMe ak ). By Taylor 
linearization, we have 


sieges . + “ad ui, 
?, =¥, +(a-w> p'0, -¥,)0 0 + 0,(N In), 
where 
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el 
Yo= > (1—a,)Z,2; cy) bs (1— a; )2; 9; on) 
U U 


Assuming that f(u,;n)/On is uniformly bounded, we 
have 


EA th) POLY Hae) 


Hence, the component V,[E’, (Y, ip ~Y |a)] 18 approximately 
given by (35) and v, is given by (36) with p, replaced by 
p;. In the case of modified random regression imputation, 
the component due to random imputation will be estimated 
by (37) with p, replaced by ,. 


4.3 Simulation Study 


We performed a limited simulation study to assess the 
performance of the variance estimators considered in 
sections 4.1 and 4.2. We generated a population of size 
N =2,500 containing two variables y and z. First, the 
variable z was generated from a Gamma distribution with 
scale parameter equal to 4 and shape parameter equal to 10. 
The y—values were then generated according to the ratio 
model 

Yt 2a oes 
where the €,’s are generated from a normal distribution 
with mean 0 and variance o*. The value of the parameter y 
was set to 2 and the variance o* was chosen to lead to a 
model R*-—value approximately equal to 0.81. The 
objective is to estimate the population total Y =), y;. 

We generated R=10,000 simple random samples 
without replacement from the finite population using the 
following sampling fractions n/N :0.05; 0.1 and 0.25. In 
each sample, nonresponse to item y was generated 
according to the following response mechanism: Response 
probability p, for unit i is given by the logistic model 


log ; ee = "Nig, + gz: 
The values of 2, and 2, were chosen to give an overall 
response rate approximately equal to 70%. The response 
indicators a, were then generated independently from a 
Bernoulli distribution with parameters p,. 

To compensate for the nonresponse to item y, we used 
the modified deterministic ratio imputation for which the 
imputed values are given by (19). From each simulated 
sample, we calculated the imputed estimator Y, given by 
(2) with the imputed values (19). As a measure of the bias of 
a variance estimator v, we used the relative bias 
[E(v) -MSE(Y, )]/MSE (Y,). Let v,,. denotes the total 
variance estimator obtained by summing (34) and (36) when 
the response probabilties p, are replaced by the estimated 
response probabilities p, and Vv... denotes the total 
variance estimator obtained by summing (38) and (36) with 
p; replaced by p,. Table 5 gives the relative bias (in %) of 
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the two variance estimators. It is clear from Table 5 that 
both variance estimators lead to underestimation, but V.,,.ect 
is slightly better in terms of underestimation. Also, both 
variance estimators performed well with a relative bias less 
than -10%. Hence, the simpler variance estimator v 
might be suitable in practice. 


naive 


Table 5 
Relative Bias (%) of the Variance Estimators 
fi RB Grane ) RB(Veorrect ) 
0.05 —6.3 —5.] 
0.10 —5.8 —4.] 
25 —4.3 —3.2 


5. Estimation of Domain Means 


In practice, estimates for various domains (subpopu- 
lations) are often needed. For example, in the Canadian 
Labour Force Survey, estimates of unemployment are 
required by age-sex group and by industry at the provincial 
level. To compensate for item nonresponse, the proposed 
modified regression imputation may be used. However, the 
domains must be specified in advance at the imputation 
stage. In other words, the domain indicators must be part of 
the imputation model. In practice, domains are generally not 
specified at the edit and imputation stage and domain 
estimates are obtained from imputed data based on imputa- 
tion models without the domain indicators. As a result, the 
imputed estimators for domains are generally biased. We 
propose a bias-adjusted estimator, along the lines of section 
2.2, to remedy this problem. The bias-adjusted estimator can 
be obtained at the estimation stage and does not require the 
specification of the domains at the imputation stage. 

A vector of domain means may be expressed as 


HY 
Yay = » Xj 7 x Xi Vj» (39) 
U U 


where x =(X,;,---,%gj>-+-»Xp;) 18 a vector of domain indi- 
cators, x,;, such that x,,=1 if ie domaind and x,, =0, 
otherwise. We assume that x is known for all the units 
ies. In other words, only item y may be missing. In the 
absence of nonresponse, an approximately unbiased esti- 
mator of Y, a) 18 given by 


“5 
Yi 5 = [> w,X; | »s W;X; Yj. (40) 


In the presence of nonresponse to item y, an imputed esti- 
mator of Y,,) is given by 


A 


Yivay = ap W,a;X; J; +) w-ans 


Sey Waxy, (41) 
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where T=), w,x,xj. Note that the imputed estimator 
Vea in (41) does not require the response identifiers, a,. 
Haziza and Rao (2005) showed that the imputed estimator 
eee is biased under assumption NM. They proposed a 
bias-adjusted estimator which is approximately unbiased 
under either assumption NM or assumption IM. In this 
section, we propose an extension of the Haziza-Rao bias- 
adjusted estimator which is approximately unbiased under 
either assumption GNM or assumption IM. 

It is easily seen that, under assumption GNM, the 
conditional nonresponse bias of the imputed estimator (41) 
that uses the modified deterministic regression imputation 
(18) is given by 


AY 


Biasl Ya | s\ -T" bs w,(1— p;) XV; — ood (42) 


where ¥,y 1S given by (15). An approximately condi- 
tionally unbiased estimator of the bias in (42) is given by 


A 


A, isl 15: W,a;X;(V; -17,)| (43) 


where Y, is given by (17). A bias-adjusted estimator, 
Ya)» 18 then obtained as Y\4) — B(Yi(a) | 5), which leads 
to 


Ya = ‘i be 223 x4 = ZA a > ent} (44) 
Ss 1 AY 

The bias-adjusted estimator (44) is approximately 
unbiased under either IM or GNM. Hence, it is robust in the 
sense of validity under both assumption IM or assumption 
GNM. However, it requires both the response identifiers a; 
and the estimated response probabilities p,, unlike the 
imputed estimator Yj.) in (41). 

It is possible to obtain a bias-adjusted estimator of the 
form (44) if we use the traditional deterministic regression 
imputation instead. It is interesting to note that the bias- 
adjusted estimator is identical to the estimator obtained 
using calibrated imputation (Beaumont 2005). The latter 
estimator does not require the knowledge of a, and p, in 
the imputed data file but the domains must be specified at 
the imputation stage, which may not be feasible in practice. 

If the nonresponse model (4) contains only the intercept, 
we have p,=p, where p denotes the overall response 
rate. In this case, the bias-adjusted estimator (44) reduces to 


Mia = pe Ney lie pL, WX ZiY1> (45) 


noting that 7, =,, where, under deterministic regression 
imputation, 
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ies 


VY (> w.n2 0%) 


> w,a;Z; y; (d'Z,) +>) w,l-a,)z; y, /(0'2; ) 
=4,. 

Haziza and Rao (2005) obtained the bias-adjusted estimator 

(45). 


Concluding Remarks 


For simplicity, we focussed on a single imputation class 
but our GNM method readily extends to multiple imputation 
classes by using separate imputations across classes. For 
example, we could use weighted mean imputation within 
classes using our modified weights w,. Also, our method 
can be extended to the case of composite imputation (Sitter 
and Rao 1997; Shao and Steel 1999 ) which uses different 
imputations for missing item values depending on the 
auxiliary information available. For example, ratio impu- 
tation is used when an auxiliary variable x is observed and 
some other imputation when x is not observed. In this case, 
the IM approach based on the ratio model relating y to x 
will not be applicable unlike in the case where x is observed 
on all the sampled units. 
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A Model for Estimating and Imputing Nonrespondent Census 
Households under Sampling for Nonresponse Follow-up 


Elaine L. Zanutto and Alan M. Zaslavsky | 


Abstract 


Sampling for nonresponse follow-up (NRFU) was an innovation for U.S. Decennial Census methodology considered for the 
year 2000. Sampling for NRFU involves sending field enumerators to only a sample of the housing units that did not 
respond to the initial mailed questionnaire, thereby reducing costs but creating a major small-area estimation problem. We 
propose a model to impute the characteristics of the housing units that did not respond to the mailed questionnaire, to benefit 
from the large cost savings of NRFU sampling while still attaining acceptable levels of accuracy for small areas. Our 
strategy is to model household characteristics using low-dimensional covariates at detailed levels of geography and more 
detailed covariates at larger levels of geography. To do this, households are first classified into a small number of types. A 
hierarchical loglinear model then estimates the distribution of household types among the nonsample nonrespondent 
households in each block. This distribution depends on the characteristics of mailback respondents in the same block and 
sampled nonrespondents in nearby blocks. Nonsample nonrespondent households can then be imputed according to this 
estimated household type distribution. We evaluate the performance of our loglinear model through simulation. Results 
show that, when compared to estimates from alternative models, our loglinear model produces estimates with much smaller 
MSE in many cases and estimates with approximately the same size MSE in most other cases. Although sampling for 
NRFU was not used in the 2000 census, our estimation and imputation strategy can be used in any census or survey using 
sampling for NRFU where units are clustered such that the characteristics of nonrespondents are related to the 
characteristics of respondents in the same area and also related to the characteristics of sampled nonrespondents in nearby 


areas. 


Key Words: Missing data; Small area estimation; Iterative proportional fitting; Log-linear models; ECM. 


1. Introduction 


Sampling for nonresponse follow-up (NRFU) was an 
innovation for U.S. Decennial Census methodology con- 
sidered for the year 2000 (U.S. Bureau of the Census 
1997a, b). Under current procedures used in 99% of house- 
holds, the Census Bureau first mails or personally delivers a 
questionnaire, to be returned by mail. Then field enumer- 
ators attempt to contact all mail nonrespondents (about 35% 
of those mailed). The workload of about 42 million 
households makes this one of the most expensive census 
operations. 

Sampling for NRFU involves sending field enumerators 
to only a sample of the nonresponding housing units. This 
sample is either an unclustered element sample of non- 
responding housing units (the “unit sample’) or a cluster 
sample consisting of all nonresponding units in a sample of 
the census blocks (small areas approximating a city block or 
some compact rural area, averaging about 15 housing units). 
This second stage of followup leads to the completion of a 
questionnaire (through proxy response or imputation, if 
necessary) for all sample housing units, except those that are 
resolved to be vacant. 

The potential cost savings of sampling are large, but it 
would require estimating the characteristics of a huge 


number of nonsampled nonresponding households, posing a 
major small-area estimation problem (Ghosh and Rao 1994; 
Rao 2003). We show that using appropriate models to 
impute the characteristics of the nonsample nonrespondent 
households, we may benefit from the large cost savings of 
NRFU sampling while still attaining acceptable levels of 
accuracy for small areas. Our strategy is to model household 
characteristics using low-dimensional covariates at detailed 
levels of geography and more detailed covariates at larger 
levels of geography. To do this, households are first 
classified into a small number of types. A hierarchical 
loglinear model then estimates the distribution of household 
types among the nonsample nonrespondent households in 
each block. This distribution depends on the characteristics 
of mailback respondents in the same block and sampled 
nonrespondents in nearby blocks. Nonsample nonrespon- 
dent households can then be imputed according to this 
estimated household type distribution. 

Although, for complex legal reasons, sampling for 
NRFU was not used in the 2000 census, our estimation and 
imputation strategy can be used for small area estimation or 
imputation in any census or survey using sampling for 
NRFU where units are clustered such that the characteristics 
of nonrespondents are related to the characteristics of 
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respondents in the same area and also related to the 
characteristics of sampled nonrespondents in nearby areas. 
The related methodologies of Purcell and Kish (1980) and 
Zhang and Chambers (2004) also use loglinear models to 
estimate small-area cross-classified counts assuming that the 
total populations are known and that auxiliary cross- 
classified data is available at the small area level. We have 
an additional source of information, specifically the 
characteristics of the nonrespondents in the NRFU sample. 
This allows us to model the relationship between respon- 
dents and nonrespondents directly in some blocks. 

Section 2 summarizes proposed strategies for imputing 
missing data in this situation. Section 3.1 describes our 
general sampling and estimation procedure. We present our 
estimation and imputation model in Section 3.2, our 
smoothing and estimation procedures in Section 3.3, and 
evaluate our model by simulation in Section 4. Methods for 
MSE estimation are summarized in Section 5, and Section 6 
presents conclusions. 


2. Previous Proposals for Imputing Census 
Nonrespondents 


Several methods have been proposed for imputing the 
characteristics of nonresponding housing units. “Top-down” 
strategies first estimate counts for aggregates of households 
and then allocate them to small areas in a manner that 
maintains consistency with the aggregates. Simple ratio 
models (Fuller, Isaki and Tsay 1994, henceforth “FIT’), 
Poisson regression models (Bell and Otto 1994), or more 
complex loglinear models (as we propose here and in 
Zanutto and Zaslavsky 1995b, a) are used to estimate counts 
for small areas and detailed demographic groups for which 
direct estimates are not possible. Like us, FIT classify 
households into a modest number of types defined by 
important characteristics (e.g., number of people, race, 
tenure) and then estimate the number of households of each 
type among nonsample nonrespondents. A complete census 
roster is then generated by imputing the estimated number 
of households of each type. The main difference between 
our approach and that of FIT is that by using a loglinear 
model rather than a stratified ratio model, we obtain more 
flexibility in the detail of constraints imposed at various 
levels of geography. Bell and Otto (1994) estimate the 
number of people over 18 years old of each race (Hispanic, 
non-Hispanic Black, Other) in each nonsample nonrespon- 
dent housing unit but do not consider how to group imputed 
persons into households or how to impute household-level 
characteristics such as tenure. These adhoc “top-down” 
models incorporate at most a few household characteristics 
and hence do not explicitly model household structure, but 
they are designed to maintain the consistency of the 
aggregates that are considered most important. 
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Schafer (1995) develops a “bottom-up” strategy in which 
households are built up from individual persons and their 
characteristics and relationships, each of which must be de- 
scribed by its own model. These models describe the 
population in more detail and can support full probability 
(e.g., Bayesian) inferences about unobserved characteristics. 
However, this approach, unlike the other, requires that a 
fairly complex set of models be built before any imputations 
can be made. Furthermore, in this framework it is more 
difficult to maintain consistency between microdata and 
aggregate controls. A combined strategy, however, could 
use our models to produce nearly unbiased estimates by 
household types and Schafer’s models to complete the 
imputations. 


3. Estimation Procedures and Models 
3.1 Overview 


In the first step of the imputation procedure, counts of the 
number of nonsample nonrespondent households of each 
type are predicted using a combination of logistic and 
loglinear models for each block. This step is the topic of this 
paper (and of FIT). 

For modeling we classified households into types based 
on a few important characteristics. Here we use 19 types, 
one of which is “vacant.” The remaining 18 are defined by 
the cross-classification of households by three size 
categories (1—2 people, 3—4 people, 5 or more people), three 
race categories (Hispanic, non-Hispanic Black, Other), and 
two tenure categories (owner, renter). 

To predict the number of vacant housing units among 
nonsample nonresponding units in each block we (and FIT) 
fitted a logistic regression model, recognizing that the 
relationship between respondent and nonrespondent house- 
holds is different for vacant than for nonvacant housing 
units. Respondent vacants are simply those that were 
identified as vacant by a postal service letter carrier, leading 
to mail return of the original questionnaire. Their distri- 
bution is likely to depend largely on housing characteristics 
related to postal delivery, telling us little about the distri- 
bution of nonrespondent vacants. 

After modeling vacancies, we fitted a loglinear model to 
predict the distribution of the nonvacant household types in 
the remaining nonsample nonrespondent households at three 
geographical levels. The block is the smallest unit and the 
one for which estimated counts are calculated. The 
“estimation domain” is the largest unit and is the area in 
which estimation is conducted independent of other such 
domains; in our application to the 1990 census, this is the 
area for which the census was administered from one of 449 
district field offices (DO) representing about 200,000 
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households on average. Finally, we call an intermediate 
level of geography an “area”, comprising a relatively ho- 
mogeneous collection of contiguous blocks within an 
estimation domain. In standard Census Bureau geography 
these might be census tracts, block groups, or Address 
Register Areas. 

We lay out briefly the remaining steps that would be 
followed to obtain census products using the estimates. In 
the second step of the imputation procedure the predicted 
counts would be rounded to integers. Unbiased schemes 
(i.e., stochastic procedures that in expectation impute the 
predicted number of units in each cell) for “controlled 
rounding” (i.e., rounding in a two-way table while pre- 
serving marginal totals) were developed by Cox (1987) and 
George and Penny (1987). However, more research is 
needed to determine if these methods can be modified to 
round households counts while preserving all the margins 
corresponding to effects in the loglinear model. This is an 
active research topic due to its importance to statistical 
nondisclosure. 

Finally, detailed person and household information 
would be imputed for nonrespondent households by sub- 
stituting donor households with similar characteristics. 
Donors can be chosen from the sampled nonrespondents, 
the respondents, or a combination of both sources. Finally, 
tabulations and microdata samples would be prepared from 
the completed rosters. 


3.2 Loglinear Model 


We fitted a loglinear model to estimate the prevalence of 
the various types of households among nonsample non- 
respondent households in a DO, using data from the 
respondents and from the nonrespondents in the NRFU 
sample for that DO. The model predicts household types for 
nonsample nonrespondent households in each block by 
using information about the characteristics of respondent 
households in the same block and the characteristics of 
nonrespondent households, measured by the NRFU sample, 
in surrounding blocks. To accomplish this, the loglinear 
model contains interactions among the household charac- 
teristics that define household type and response status at 
various levels of geography. 

This modeling strategy is motivated by the fact that when 
a hierarchical loglinear model (i.e., one in which for every 
included interaction effect, all main effects or interactions 
marginal to it are also included) 1s fitted by maximum 
likelihood, the fitted values for every margin or mean 
corresponding to an effect in the model are equal to the 
corresponding observed margins or means (Birch 1963). 
Therefore, predictions for household types agree with 
observed rates for the characteristics included in the model, 
at the levels of geography and response status corresponding 
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to the interactions included in the model. Also, because 
model predictions for the included effects are constrained to 
agree with observed rates based on a probability sample (the 
NRFU sample), the corresponding estimates are consistent 
and approximately unbiased. (Exact unbiasedness is not 
obtained because of the nonlinearity of the prediction model 
and because the number of nonsample nonrespondent 
households in a block might be associated with some 
characteristics of the nonresponding households in the 
block.) 

The loglinear model includes nested geographical factors 
for blocks and areas. It also includes crossed factors 
representing the demographic characteristics of households: 
first-stage response indicator (respondent or nonrespondent 
household), household type index, and model expressions in 
the variables that define household types. These model 
expressions are submodels of the fully interacted model 
which defines household type (i.e., race x size x tenure). 

We use the following notation: 

i= 'blockitindex Gr hen; 
blocks in the DO), 

j =tdex of household type (j = 1, ..., 
number of types), 

r =first-stage (mail) response indicator, 
r = 0 for nonresponding households 
and r = 1 for respondents, 

a = a(i) =index for the area containing block 

i(a = 1, ..., number of areas), 

= model expressions in the variables that 
define household types where x, rep- 
resents the full cross-classification de- 
fining household types, x, and x, are 
model expressions which are marginal to 
x,, and x, is a model expression which 
is marginal to x,. (This terminology is 
explained below.) 


number of 


X, =X, (J) 
= 15823. 4 


We assume a loglinear model of the following form: 


Nn, ~ Poisson(m,,), log(m;,.) = Zap (1) 


ijr 
where n,,. and m,,. are respectively the observed and ex- 
pected counts for block i, household type 7 and response 
status r, and Z is the design matrix corresponding to the 


following model formula: 
Kil AE he ea re Aare Xd Be BEI ie CZ) 


In the standard generalized linear models notation of 
Wilkinson and Rogers (1973), the “*” operator indicates 
that the main effects and all interactions that are marginal to 
the given interaction are included in the model, so that this 
model contains main effects for model expression x,, 
response indicator r, and block indices i and the 
lilteractions 2 * X,,1 #1. 7 *x,,,and r Fa * X, . 
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Because, in (1), x, interacts with area, the smallest level 
of aggregation for the non-respondent data, it should 
represent a fairly coarse classification of households in- 
cluding only those household characteristics that are most 
important to impute accurately at the area level. The x, 
expression may include terms not included in x,, since it is 
fitted at a higher level of geography where there is more 
data available. Similarly, the x, expression might include 
the most interactions, including the interaction of all 
variables that define household type, since it is fitted at the 
largest level of geography, using all available data. Finally, 
x,, which can be different than x, since it interacts with i 
instead of +, should be less detailed than x, since it 
interacts with block, a much smaller level of geography. 
These guidelines are motivated by the fact that estimates of 
interactions with 7, r, or a are determined by relatively 
few observations and should be kept simple. Choosing 
X5, X;, and x, as described above should improve the 
precision of model estimates while preserving the most 
important margins. 

As an example of possible x,, ..., x, terms, suppose that 
we define household type by a race x size x tenure cross- 
classification. Then one possible specification of x,, x, and 
X3, 1S x, = tace * size * tenure, x, = race * size + ten- 
ULE, “X,. = Sizer* tenure, ands x7) = ace + size-+ tenure, 
Allowing the x,,..., x, terms to be model expressions, 
rather than just simple interactions, gives us a concise way 
to represent a model containing all the desired interactions. 
For example, a model containing an 7 * x, term, where x, 
is specified above, includes both a block x race x size 
interaction and a block = tenure interaction. 

A heuristic interpretation of our loglinear model 1s that 
we estimate the detailed distribution of household types 
across the whole area (x, ) and then shift that distribution to 
allow for the general characteristics of the block (x,), the 
general differences between responding and nonresponding 
households (x,), and the most important differences 
between responding and nonresponding households in the 
particular area (x,). All interactions could be included 
except those of the form r * i * x, where x represents a 
model expression in the variables that define household type 
(i.e., such as x,, X,, X;, or x, ). Interactions of this form 
depend on the margins determined only by non-respondent 
households in a single block and these are unavailable in 
nonsample blocks under the block sample design, and based 
on a very small sample under the unit sampling design. 
Therefore our model specification excludes all r * i * x 
effects, which are always inestimable (or poorly estimated, 
in the household sample design). This model generalizes 
two simple theories which are contained as submodels. 
First, if there are no differences between blocks (i.e., the 
loglinear i * x, and a* x, interactions are zero) then 
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nonrespondent households in each block are imputed 
according to the overall proportion of nonrespondent house- 
holds in each of the x, categories in the NRFU sample, 
through the r * x, effect. In other words, the imputations 
are made using the same proportions in each block. Second, 
if there are no differences between respondents and non- 
respondents (i.e., no r * x, or r * x, Interactions) then 
nonrespondents are imputed in the same proportions as 
observed in the respondents in each block. 

Our general model formulation can accommodate many 
definitions of area and household type and choices of model 
expressions. Areas should be defined to be large enough to 
contain adequate data to estimate the corresponding inter- 
actions, but also relatively homogeneous. For example, 
areas could be defined by a combination of geographical 
contiguity and stratification by block-level covariates (such 
as percent minority), in order to obtain more homogeneous 
areas whose differences could be described by modeling. 
Generalization to more than two levels of geography within 
the estimation domain is also straightforward. Thus, for 
example, we could interact another model expression x; 
with a geographical unit intermediate between the area and 
the block. 

Fitting the model by maximum likelihood, the following 
quantities are made equal to the corresponding observed 
values: (1) fitted block counts (through the main effect for 
block, i), (2) response rates by block (through the r * i 
term), (3) household characteristic means overall (for x, 
characteristics through the main effect term for x, ) and (4) 
by block (for x, characteristics through the i * x, term), 
and (5) household characteristic means for nonrespondents 
overall (for x, characteristics, through the r * x, term) 
and (6) for nonrespondents by area (for x, characteristics, 
through the r * a * x, term). Thus, this model generalizes 
the model used by FIT of block x type independence, 
yielding unbiasedness at smaller levels of aggregation, 
assuming that the margins and averages are estimated un- 
biasedly from the data. The estimate for area is not exactly 
the same as the usual unbiased estimate obtained by direct 
estimation from the NRFU sample because the model 
makes observed and fitted margins agree for the households 
in sample. In effect, there is covariance (regression) ad- 
justment that shifts the aggregate to account for observed 
differences between respondent households in sample 
blocks and respondent households in nonsample blocks, or 
in the unit sampling design, between respondent households 
in blocks with households in the NRFU sample and blocks 
without households in the NRFU sample. 

The idea of modeling household characteristics using 
low-dimensional covariates at the block level and in more 
detail at more aggregated levels is similar in concept, 
although not in details, to the model described in Zaslavsky 
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(2004). For use of loglinear weights to match sample 
estimates of aggregates, see Brackstone and Rao (1976), Oh 
and Scheuren (1983), and Zaslavsky (1988). 


3.3. Estimation and Smoothing 


We fit the model by maximum likelihood estimation 
under the Poisson sampling model, which is equivalent to 
fitting a multinomial logistic regression model. The fitting is 
complicated by the fact that the data do not form a complete 
block x response x type table because we have counts by 
block, but not characteristics for nonsample nonresponding 
households. In the block sampling design we lack char- 
acteristics of all nonrespondents in some blocks and in the 
unit sampling design we lack characteristics of some non- 
respondents in almost all blocks. To fit the model we use a 
modified iterative proportional fitting (IPF) algorithm 
adapted to data that are partially classified in a part of the 
dataset (Appendix). 

With some data sets, some parameters may be inesti- 
mable because the maximum likelihood estimates lie on the 
boundary of the parameter space (infinite on the loglinear 
scale, indicating a zero on the count scale) or because there 
is no information for the parameter. Tailoring the model 
specification in each estimation domain to remove inesti- 
mable parameters is impractical in a census production 
setting. 

By introducing a small amount of prior information, 
estimability of all parameters can be guaranteed. To do this, 
we append a small amount of “pseudo-data” to the data for 
each area, whose proportions by type are equal to those for 
some surrounding area (the DO, in our simulations), by 
adding these counts to the data table before fitting the 
model. This implements an empirical Bayes analysis for 
multinomial data with distribution /(7,...,2, | Py. 
ero; su. where 11)... ate, the observed 
number of households of each type in a block or area. If 
{p,} have a joint Dirichlet prior distribution, /(),,..., 
ie Gels gD oe ake 2 Os ee the = resulting... posterior 
distribution for the p,’s is Dirichlet with parameters 
a, + x, (Gelman, Carlin, Stern and Rubin 1995, page 76) 
and posterior mode proportional to the parameters. Thus, 
this empirical Bayes procedure is equivalent to adding 
>a, households to the area, where a, of these households 
are of the i" type. We fix the a, ’s to be proportional to 
the observed proportions of each household type in some 
surrounding area, so the observed distribution of household 
types is smoothed by mixing it with the distribution for a 
surrounding area, thus avoiding introducing bias at the level 
of the larger area. This prior specification induces a prior on 
the parameters of the loglinear model. See Rubin and 
Schenker (1987), Zaslavsky (1988), and example and 
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historical references in Clogg, Rubin, Schenker, Schultz and 
Weidman (1991) for similar use of smoothing. 

After estimating the model parameters, the next step is to 
calculate predicted counts for each household type for the 
nonrespondent households that are not in the NRFU sample. 
Using the IPF algorithm, the predictions for the nonsample 
nonrespondent households are obtained automatically by 
applying the same fitting proportions to the partially 
observed part of the table as to the fully observed part of the 
table, so no further calculation is required (Appendix). 


4. Simulations 
4.1 Overview 


Our simulation study evaluated the bias, variance and 
MSE of the estimates of estimated demographic aggregates 
(such as the number of households by race, size and tenure) 
at various levels of geography, using estimated household 
compositions for non-respondent households that are not in 
the NRFU sample. Analytic evaluations are infeasible, 
given the complexity of the models and sampling scheme, 
the dependence of the performance of the model on the 
actual geographical distribution of household types, and the 
number of variations of the model that could be examined. 

We used block-level data from three DOs from the 1990 
U.S. Decennial Census; these constituted our estimation 
areas. The simulations are similar in structure to those 
described by Schindler (1993) or FIT. 

The steps of the simulation are as follows: 


1. Blocks or nonrespondent housing units are sampled 
according to the NRFU sampling scheme. 

2. A logistic regression model for vacant households is 
fitted to the respondent households and the sampled 
nonrespondent households. 

3. The predicted number of nonrespondent households 
that are vacant is calculated for each block. 

4. A model for nonvacant types is fitted using the 
respondent households and the sampled non- 
respondent households. 

5. The predicted number of nonsample nonrespondent 
households of each nonvacant type are calculated for 
each block. 

6. Aggregates of interest are calculated based on the 
predicted counts, and compared to the truth using loss 
functions. 


In our simulations, repeating these steps 30 times yielded 
estimates of RMSE (defined in section 4.3) with adequate 
accuracy to evaluate the performance of our model relative 
to the alternative models. Specifically, the estimated coef- 
ficients of variation of the estimated differences in RMSE 
for the stratified ratio method (described below) and 


Statistics Canada, Catalogue No. 12-001-XPB 


70 Zanutto and Zaslavsky: A Model for Estimating and Imputing Nonrespondent Census Households 


loglinear method are less than 0.05, except when the 
difference between estimated RMSEs is very small, 
resulting in a large coefficient of variation. 

The performance of our proposed model is compared 
with two alternative estimation methods, under both the unit 
and block sampling designs. Each method first fits a logistic 
regression model to estimate the number of nonrespondent 
households that are vacant in each block. The first alter- 
native, the “unstratified ratio method”, imputes households 
for nonsample nonrespondent households in each block in 
proportion to the distribution of household types among 
nonrespondent households in the follow-up sample for the 
entire DO. The second alternative, the “stratified ratio 
method’, is a version of that in FIT. We first form strata of 
approximately 82 blocks based on the racial composition of 
the blocks, as described by FIT. (We use both respondent 
and nonrespondent data to form strata, assuming, as in FIT, 
that similar information would be available from admin- 
istrative records. Stratification based only on respondent 
information yielded similar results.) Then, in each stratum, 
nonsample nonrespondent households are imputed to non- 
vacant types in proportion to the frequency of the type in the 
follow-up sample for that stratum. 

We simulate each estimation method using a NRFU 
sampling rate of 30%. In each stratum, we simulate NRFU 
sampling by selecting a 30% simple random sample of 
blocks for the block sampling design, and a 30% simple 
random sample of nonrespondent households in each 
stratum for the unit sampling design. The characteristics of 
the nonrespondent households in these samples is assumed 
to be known (i.e., as a result of follow-up operations). For 
both our loglinear model method and the stratified ratio 
method, we select a 30% sample of blocks or nonrespondent 
households using simple random sampling without replace- 
ment from each area. 

We considered several loglinear model formulations. The 
best model for both the block and unit sampling designs, by 
the criteria described in Section 4.3, uses x, = size * race * 
tenure, x, =race * tenure + Size; x, =fTace * size, x,'= 
tenure. This model is used in the simulations. 

To ensure the model can be fitted in every case and to 
speed the convergence of the IPF, we smooth the data by 
adding one hypothetical respondent household (‘“pseudo- 
data’) to each block. This household is divided among the 
18 nonvacant household types according to the overall DO 
proportions of respondent households. Estimates using 5 
households for smoothing were about as accurate as with 
one, and more aggressive smoothing (adding 10, 15, 20 or 
25 households per block) slightly increases errors in the 
estimates. Also, although adding only a small fraction of a 
household to each block is sufficient to ensure that the 
model can be fitted in every case, using less than | 
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household per block drastically slowed convergence and 
slightly increased the error in the estimates. 

The three estimation procedures used the same logistic 
regression model for vacancies. The covariates for each 
block are the mail nonresponse rate, the percentages of 
respondent households that are (separately) renters, apart- 
ment dwellers, and of a minority race (either Black or 
Hispanic), the average value of owner-occupied homes, the 
average monthly rent for rental units, indicator variables for 
each of the areas, and interactions between percentage of 
respondent renters and average monthly rent, percentage of 
respondent renters and average monthly rent squared (mean- 
centered), percentage of respondent owners and average 
home values, and percentage of respondent owners and 
average home values squared (mean-centered). To avoid 
computational problems arising from blocks with no non- 
respondent vacant households, one hypothetical non-re- 
spondent household is added to each block divided between 
vacant and nonvacant according to their proportions in the 
sampled nonrespondent households in the DO. 


4.2 Data 


We use short-form data from the 1990 census for three 
DOs, whose characteristics are described in Table 1. The 
race of a household is determined by the most prevalent race 
in the household, usually (98% of households) the only race. 
In DO 1 we grouped consecutive (and therefore contiguous) 
block groups (clusters of contiguous blocks) into 94 areas 
containing an average of 52 blocks and 1100 households. 
For DOs 2 and 3, block group information was unavailable 
so we formed areas by grouping consecutive blocks into 
clusters containing an average of 50 blocks (on average, 548 
households per area in DO 2 and 918 households per area in 
DO 3). 


Table 1 
Characteristics of the Census District Office Areas 
Used in the Simulations 


DOI DO2 DO3 
Household 112,966 169,321 149,567 
Blocks 4,907 15,470 8,167 
Pseudo-areas 94 309 163 
Non-Hispanic Black 14.4% 28.5% 1.3% 
Hispanic 6.1% 1.0% 6.6% 
Other 73.5% 59.4% 81.5% 
Owner 63.8% 59.5% 52.6% 
Renter 30.2% 29.4% 36.7% 
Vacant 6.0% 11.1% 10.7% 
Size 1(1—2 people) 50.4% 46.9% 35.2.0 
Size 2(3—4 people) 31.6% 31.6% 26.2% 
Size 3 (5+ people) 12.0% 10.4% 7.9% 
Response Rate 72.6% 65.3% 56.7% 
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4.3. Measures of Bias, Variance, and Mean 
Squared Error 


Loss functions for our evaluations are based on the 
relative error for household category j (a type or combi- 
nation of types) in geographic area i (a block or collection 
of blocks): 


per a 

di, = o.aaetl (3) 
where Y;,, is the true number of households of category j in 
geographical unit i, Y;, is the corresponding number of 
households estimated from sample s (including those 
observed in the sample and estimated by the model), and 
Y,, 1s the total number of households in geographical unit 
We 

We summarize bias in estimated counts for category / 
and a level of geography (block, area, DO) with Root Mean 
Weighted Squared Bias (RMWSB): 


RMWSB? = 
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where § is the number of samples drawn and i=1, ..., / 
where J is the number of geographical units. The second 
term in the numerator removes a bias due to the finiteness of 
the simulation. From a design-based perspective, we regard 
the composition of each area as a fixed quantity, and only 
sampling is random. Then bias is defined as the average 
difference, over all possible samples, between the truth for 
an area and the corresponding estimates, essentially the 
model error for that area. Such error is inevitable since the 
composition of the nonrespondents in any block is not 
entirely predictable. A more serious type of bias would 
involve systematic error in estimates for a collection of 
blocks with similar composition. Although we have not 
checked for all possible types of bias in this sense, the 
model specification protects us against bias at higher levels 
of aggregation because model estimates are constrained to 
agree (approximately) with unbiased estimates for areas and 
DOs. 

As a measure of overall error, we calculate the Root 
Mean Weighted Mean Squared Error (RMWMSE) for each 
household category 7, which is given by 


wee GIs ) 
BG 


(4) 


RMWMSE* = (5) 
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where Y,,, ay Y,,,7, and § are defined as above. (The 
two “means” refer to mean over geographical units (i) and 
over samples (s).) We obtain a measure of the standard 
deviation of the estimates for household category j by 


calculating the Root Mean Weighted Variance (RMWV): 


En gh(5.48 Hoan) 
Fn 


= RMWMSE; - RMWSB;. (6) 


RMWV> = 


Note that these MSE, bias, and standard deviation measures 
are all estimates of expectations with respect to repeated 
NRFU sampling from the given finite population of blocks. 
These loss functions can be applied at various levels of 
geography, reflecting the fact that the main use of block 
level estimates is aggregation to form estimates at higher 
levels of geography. With this in mind, these measures were 
also chosen because they weight errors by the size of the 
geographical unit. This leads to consistent estimates of error 
when aggregating over geographical units, which is appro- 
priate due to the arbitrariness of unit boundaries (Zaslavsky 
1993). We base our measures on errors relative to the total 
area i population rather than the population in the target 
category only, because the latter denominator inflates the 
importance of small errors in blocks where the category 
rarely or never appears. 


4.4 Results 


For simulated NRFU sampling using both the block and 
unit sampling designs, estimates of the number of house- 
holds with each characteristic are calculated at block, area, 
and DO levels of geography using each of the three 
estimation methods. The results for each method are rep- 
resented by the shaded bars in Figure | for the unit sampling 
design. (Results for the block sampling design are not 
shown here, but the pattern of results are similar with the 
RMWMSE being about 10% greater for all estimates.) In 
this figure, each row of bar charts displays the RMWMSE 
for block, area, and DO level estimates for one of the three 
DOs. Each group of three bars represents the RMWMSE for 
estimates of the total number of households for each of the 
tenure categories, the household size categories and the race 
categories using each of the three methods. Because all 
three methods use the same logistic regression model to 
predict the number of vacant nonsample nonrespondents in 
each block, the vacant category is omitted from the plots. 

RMWMSE with both the stratified ratio method and the 
loglinear model was much smaller than with the unstratified 
ratio method for most household characteristics at the block 
and area level. Therefore, we confine further discussion to 
comparison of the two former methods. 


Statistics Canada, Catalogue No. 12-001-XPB 


2 Zanutto and Zaslavsky: A Model for Estimating and Imputing Nonrespondent Census Households 


The most dramatic differences appear for the tenure 
categories at the block and area levels. In each DO, block 
and area level estimates of the tenure categories from the 
loglinear model have much smaller RMWMSE than the 
estimates from the stratified ratio method, primarily because 
the former had much smaller bias (RMWSB). Standard 
deviations (RMWYV) were slightly larger for the loglinear 
model under the unit sampling design, but about equal for 
the two methods under the block sampling design. The 
loglinear model had smaller bias for the tenure categories at 
the area level because tenure is included in the model as an 
area-level effect, x,. Stratification on race in the ratio 
method reduces RMWMSE for the race categories at the 
block level, but the two methods have comparable 


RMWMSE for the race categories at the area and DO levels. 
The stratified ratio method loses its advantage over the 
loglinear model at the area level because the former does 
not use any area-level information. Both methods generally 
produce estimates with comparable RMWMSE at all levels 
of geography for the size categories. 

The statistical significance (under the simulations) of 
differences in RMWMSE between the methods was eval- 
uated using t-tests. Almost all differences at the block and 
area levels, excluding the vacant category, have two-tailed 
p-values <0.001 and therefore cannot be attributed to 
simulation error. 
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Figure 1. RMWMSE for block, area, and DO level estimates for each household characteristic, using 
the unit sampling design for DO 1, 2, and 3, with 30 simulated samples (““Ow” = Owner, 
“R” = Renter, “B” = Black, “H” = Hispanic, “O” = Other race, “S1” = Size group 1 (1 -2 
people), “S2” = Size group 2 (3 — 4 people), “S3” = Size group 3 (5 or more people)). 
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5. Assessment and Prediction of Model Error 


Methods for estimation of MSE of fitted estimates using 
sample data are briefly summarized here due to space 
limitation; methods and findings are available from the first 
author. 

First, we developed analytic approximations that predict 
the effect of changing the sampling rate on the accuracy of 
our estimates without requiring additional simulations at 
each rate. These can be useful for sample design. We 
approximate the RMWMSE of block, area, and DO level 
estimates at a new sampling rate under both the block and 
unit sampling designs, assuming simulation results using 
one sampling rate are already available, by combining 
estimates of bias and variance at the current sampling rate 
using two rescaling factors. The first factor reflects the 
changed proportion of housing units that require estimation 
under the new sampling rate, which affects the bias and 
variance of the combined estimates. The other reflects the 
effect of the sampling rate on the variance of the estimates 
for the nonresponding units. Simulations demonstrated the 
accuracy of predictions for RMWMSE using these approxi- 
mations, except for some extreme extrapolations. 

Using these results, we developed a cross-validation pro- 
cedure to facilitate within-sample estimates of RMWMSE 
for use in a production setting where the true characteristics 
of the nonsample nonrespondent households are not known. 
The follow-up sample in each areas is divided randomly 
into C cross-validation groups (of blocks for block sam- 
pling, and of households for unit sampling). Each cross- 
validation group is dropped out in turn and the model is 
fitted to the nonrespondents in the remaining C— | cross- 
validation groups and the respondents in all C groups. We 
can then estimate RMWMSE under the design simulated by 
the cross-validation and project this estimate to the actual 
sampling rate, or some other rate of interest, using the 
approximations described in the preceding paragraph. 
Simulations show that this produces accurate estimates of 
RMWMEE at block and DO levels of geography, with some 
overestimation at the area level. This method also provides 
separate estimates of bias and variance that are shown by 
simulation to be very accurate. These are useful for as- 
sessing model adequacy since a poorly-fitting model would 
be betrayed by a large component of MSE due to bias. 


6. Conclusions 


In the preceding sections, we have presented a model- 
based approach to imputation of the characteristics of 
nonresponding households in a census that were not 
sampled for nonresponse followup. In simulations, our 
loglinear model produces estimates with much smaller error 
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than two alternatives for some estimands, and is about 
equivalent for others. These conclusions hold for both the 
block and unit sampling designs. An advantage of our 
approach is that models can be specified to constrain only a 
few marginal tables or interactions of characteristics at the 
finest levels of geography, where the data are sparse, while 
fitting more detailed distributions of characteristics at higher 
levels of geographic aggregation at which more data are 
available. This is consistent with typical practice in release 
of census data, which include minimal characteristics at the 
block level but increasingly more detailed characteristics for 
larger units. 

Many important uses of the census involve estimation of 
the population and its characteristics for small domains such 
as legislative districts and planning areas for social services 
(such as schools and clinics) and commercial development. 
Even though these domains will not always align with the 
areas used in census estimation, controlling the census 
estimates to match unbiased estimates at several levels of 
geography makes it more likely that estimates for policy- 
relevant domains assembled from wholes or parts of these 
areas will also be nearly unbiased. Our method has more 
predictable aggregate properties than complex alternatives 
such as hierarchical spatial modeling. Although the latter 
might produce estimates with smaller MSE at the lowest 
levels of geography, fitting such models and checking their 
biases at various levels of geographic aggregation would 
require extensive local tuning which is likely to be 
impractical in a census production setting. 

Our methodology is illustrated here in the context of a 
NRFU sampling for the U.S. Decennial Census, but our 
estimation and imputation strategy can be used for small 
area estimation or imputation in any census or survey using 
sampling for nonresponse followup with hierarchically 
structured populations. We can also incorporate adminis- 
trative records as covariates for predicting the characteristics 
of the corresponding nonrespondent households (Zanutto 
and Zaslavsky 2002). In that scenario, data from households 
in the NRFU sample for which we have both census and 
administrative records information are used to estimate the 
systematic differences between the two information sources. 
Under the same models, we impute the characteristics of 
nonsample nonrespondent households. Using administrative 
records through this modeling approach can improve the 
accuracy of small area (block-level) estimates. 

Although the discussion of sampling in the United States 
census has been politically contentious, nonetheless in the 
long run it seems likely that some form of estimation will be 
used for nonrespondents. The potential might be even 
greater in countries where population estimation already 
makes substantial use of administrative records (Redfern 
1989). Methods such as those described here that can 
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combine information across data sources while reflecting 
local diversity will be essential to such efforts. 


Appendix 


Iterative Proportional Fitting with Partially 
Cross-Classified Data 


A standard approach to fitting loglinear models to par- 
tially cross-classified data uses an EM algorithm (Dempster, 
Laird and Rubin 1977; Little and Rubin 2002, chapter 8), in 
which in alternate steps (1) the expected counts are imputed 
under the model and (2) the model is refitted to the observed 
and imputed data, using iterative proportional fitting (IPF) 
(Darroch and Ratcliff 1972) for models without closed-form 
solutions. In the more efficient ECM modification of this 
algorithm, only a single cycle of the IPF algorithm is taken 
at each step (Meng and Rubin 1993). 

For our application we developed a modified IPF 
algorithm that is faster than the EM and ECM algorithms for 
our models, which always include a_ block x response 
interaction and never include any block x type x response 
interactions. We found that our modified IPF algorithm 
converges in approximately one half to two thirds the 
number of cycles that ECM requires with less computation 
per step (Zanutto 1998, Part 1, Appendix A). (Convergence 
is declared when the predicted and observed values of the 
minimal sufficient statistics of the model are sufficiently 
close.) 

Our algorithm takes advantage of the fact that partially 
classified observations contribute to the likelihood only 
through the total number of nonrespondent households in 
each block. Therefore, to maximize this part of the like- 
lihood we need only ensure that the fitted number of non- 
respondents in each block equals the observed number, 
which is automatic because the block x response interaction 
is always included in our model. 

The modified IPF algorithm fits the model to the fully 
classified observations using an ordinary IPF algorithm, 
ignoring the partially cross-classified observations. For the 
block sampling design, this means that the model is fitted 
using the fully observed part of the block =< type x response 
table using an ordinary IPF algorithm, ignoring the partially 
classified part of the table. Predictions for the partially 
cross-classified cells are obtained by applying the same 
fitting proportions to those cells as to the fully observed part 
of the table. Finally, predictions for the partially cross- 
classified cells are scaled so that the fitted number of 
nonrespondents in each block equals the observed number. 
For the unit sampling design, the same algorithm is used, 
viewing the collection of respondent households and 
nonrespondent households in the follow-up sample as 
analogous to the fully-observed part of the table in the block 
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sampling design and viewing the blocks with no non- 
respondents in the follow-up sample as analogous to the 
out-of-sample blocks in the block sampling design. This 
gives predictions for nonrespondent households in blocks 
with no nonrespondents in the follow-up sample. Predic- 
tions for nonrespondent households in blocks with one or 
more nonrespondent households in the follow-up sample are 
obtained by applying the predicted distribution of household 
types among sampled nonrespondent households in each of 
these blocks to the corresponding nonsample nonrespondent 
households in these blocks. For more details about in the 
unit sampling case, see Zanutto and Zaslavsky (2002). 

We now illustrate the IPF algorithm for the block 
sampling design under a Poisson model like (1) with 
log(m,,) = Z;,B where m,, represents the expected 
number of households in block i of household type 7 of 
response status r, and Z is the design matrix corre- 
sponding to the model expression i* x +i*r+r* xX. 
This is a simplified version of the model in (2) with only 
one level of geography and only one “x” representing the 
full cross-classification defining household types. We 
observe n,, if r = 1 or if r=0 and ie S, but only 
N..9 if i¢S, where S represents the set of blocks 
selected for the NRFU sample. 

The IPF algorithm to fit this model starts with initial 
estimates mrs, =1- ‘for“all 97, je 7° and *contains” the 


following three steps in cycle ¢: 
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The scaling factors in each step are based only on observed 
counts. 
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These steps are repeated until the estimates of the 
minimal sufficient statistics for the model, excluding ™m,,. 
for i 0S, 7. = 0 1Ge,°mzy forsi ¢ Sandi ¢S,r= 
y+ for ie S,m,, fori¢ S,m,,,, and Y;.smMjj) 
are sufficiently close to their observed values. Denoting the 
step at which this occurs as ¢, the final step in this 
algorithm is to set 


l,m 
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an Pi st fo e a 
ae Mii, SS if Pe Sir =O 
: i 
bo a Mis, 
mi: otherwise, 
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to ensure that estimated blockxresponse margin (i * r) for 
i ¢ S, r = O equals the observed margin. 

This IPF algorithm produces estimates that converge to 
the maximum likelihood estimates of the model parameters 
(Zanutto 1998, Part 1, Appendix A). The second case in 
Step 2 is not needed to maximize the likelihood but is 
included to obtain predictions for the nonsample nonre- 
spondent cells (1.e., i ¢ S, r = 0). 
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The 2006 Reverse Record Check Sample Allocation 


Alain Théberge | 


Abstract 


Sample allocation can be optimized with respect to various goals. When there is more than one goal, a compromise 
allocation must be chosen. In the past, the Reverse Record Check achieved that compromise by having a certain fraction of 
the sample optimally allocated for each goal (for example, two thirds of the sample is allocated to produce good-quality 
provincial estimates, and one third to produce a good-quality national estimate). This paper suggests a method that involves 
selecting the maximum of two or more optimal allocations. By analyzing the impact that the precision of population 
estimates has on the federal government’s equalization payments to the provinces, we can set four goals for the Reverse 
Record Check’s provincial sample allocation. The Reverse Record Check’s subprovincial sample allocation requires the 
smoothing of stratum-level parameters. This paper shows how calibration can be used to achieve this smoothing. The 
calibration problem and its solution do not assume that the calibration constraints have a solution. This avoids convergence 


problems inherent in related methods such as the raking ratio. 


Key Words: Calibration; Raking ratio; Reverse record check; Sample allocation; Smoothing. 


1. Introduction 


The Canadian Census of Population is conducted every 
five years, most recently in 2001. The Reverse Record 
Check (RRC) measures the undercoverage and part of the 
overcoverage in the Census. For the next RRC in 2006, it is 
hoped that most of the census overcoverage will be 
measured by another survey, the Automated Match Study, 
which is more efficient for this task. This should make it 
possible to optimize the RRC sample allocation for 
undercoverage measurement. RRC coverage estimates are 
used in conjunction with census counts to produce 
population estimates. The population estimates are used for 
various purposes; for example, the federal Department of 
Finance uses them to calculate the equalization payments 
that the federal government makes to the provincial 
governments. 

Traditionally, one consideration in allocating the RRC 
sample among the provinces has been to balance the need 
for a good-quality estimate of the national rate of persons 
missed by the Census and the need for good-quality 
estimates of provincial rates for use in producing Statistics 
Canada’s population estimates. 

It was hoped that this approach would also meet the need 
for good-quality equalization payment estimates (they are 
estimates because they depend on population estimates), but 
this has never been verified. The federal government makes 
equalization payments to the have-not provinces. In this 
paper, we examine the impact that the provincial sample 
allocation has on the quality of equalization payment 
estimates. 

If the variance of a variable of interest is the same in 
every province, we can obtain an optimal allocation for a 


minimum-variance national estimate if the sample size is 
proportional to the frame size for province p, N,. An 
allocation that produces provincial estimates of equal 
variance is one where the sample size is constant 
(proportional to N a) One way often used to balance the 
two needs is to make the sample size proportional to Ny ms 
A different method of achieving this balance has been used 
in the past by the RRC: part of the sample is allocated so as 
to yield provincial estimates of equal variance, and the other 
part is allocated so as to produce a minimum-variance 
national estimate. Traditionally, about two thirds of the 
sample is allocated in such a way as to produce provincial 
estimates of equal variance. 

In this paper, we propose a new method of obtaining a 
provincial allocation which balances two or more goals. 
That method involves computing a distinct allocation for 
each goal, possibly with a different total sample size for 
each allocation; we obtain the final allocation, which should 
satisfy every goal, by taking the maximum sample size over 
each of the distinct allocations for each province. 

The optimal subprovincial allocation is simply given by 
the Neyman allocation. The difficulty les in predicting the 
variance in relatively small strata, or more precisely, in 
predicting the totals (number of persons missed by the 
Census, number of RRC non-respondents) on which the 
variance depends. For each province, the approach taken in 
this paper is to start with more stable national values at the 
cell level (age x sex x marital status) and scale them so that 
the totals agree with the provincial values for each age 
group, for each sex and for each marital status. This goal is 
reminiscent of an iterative raking procedure introduced by 
Deming and Stephan (1940), also used by Brackstone and 
Rao (1976). Deville and Sarndal (1992) showed how 
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calibration can be used to achieve the same result. In the 
case of the RRC, calibration will be used even though the 
cells cannot be put in a convenient three-dimensional matrix 
because the age groups differ for each marital status. The 
raking ratio method sometimes fails to converge because the 
constraints cannot be satisfied. By stating the calibration 
problem as in Théberge (1999), we allow for the possibility 
that the constraints are inconsistent, and this does not cause 
convergence problems. In addition, if we use the Moore- 
Penrose inverse as part of the solution, the constraints can be 
linearly dependent. 

In the next section, we will explore the relationship 
between population estimates and equalization payments. 
As we will see, the sample allocation problem entails 
balancing four goals. In Section 3, we use an approximate 
variance formula that relies on a design effect to determine 
the optimal allocation for each goal. We determine the value 
of the design effect empirically in Section 4. Section 5 
explains how a final allocation can balance individual 
allocations for separate goals. Finally, the subprovincial 
allocation is addressed in Section 6. The sample allocation 
for the three territories is not discussed in this paper. 


2. Impact of Population Estimates on 
Equalization Payments 


Statistics Canada is responsible for producing population 
estimates. One important use of those population estimates 
is in computing the equalization payments made by the 
federal Department of Finance. Although Statistics Canada 
is not directly concerned with the formula for equalization 
payments, it is still relevant to examine how the precision of 
the population estimates affects the precision of the 
equalization payments. The impact that the sample 
allocation has on the precision of the population estimates 
has been studied for many years; in this paper, we will also 
examine how the sample allocation affects the precision of 
the equalization payments. 

The RRC is the survey used to measure the rate of 
persons missed by the Census. Traditionally, the RRC’s 
sample allocation has been designed to achieve a 
compromise between having a minimum variance for the 
national estimated undercoverage rate (goal I) and having 
equally low variances for the estimated undercoverage rates 
of the provinces (goal II). Two more goals will be added as 
we examine the impact that the sample allocation has on the 
precision of the equalization payments. 

The formula used to calculate the equalization payments, 
before any smoothing based on moving average, is 
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where E, is the equalization payment for beneficiary 
province p (at the time of writing, all provinces except 
Ontario and Alberta), R,, is the total revenue (all provinces) 
from revenue source j, 7, is the total tax base for revenue 
source j, 7.,4; 18 the tax base of the standard provinces (all 
provinces except the Atlantic provinces and Alberta) for 
revenue source j, P,, is the population of the standard 
provinces, 7, is the tax base of beneficiary province p for 
revenue source j, and P, is the population of beneficiary 
province p. 

To measure the influence that population estimates have 
on the equalization payments, we will rewrite equation (2.1) 


as 
E, = ca Cie ae : (2:2) 
std 
where 
ef = Ry Tj 
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We note that the population of Alberta has no impact on 
the equalization payment of any beneficiary province. The 
population of Ontario only affects the equalization payment 
through P,,. For the Atlantic provinces, their equalization 
payment varies linearly with their population, since their 
population does not affect P,,. If we assume P,, is known, 
we can say that an error of one person in a beneficiary 
province’s population has an impact of C,,/P,, dollars on 
its equalization payment, for any beneficiary province. This 
does not mean that the equalization payment of a 
beneficiary province only depends on its population and not 
on the population of the standard provinces. However, as we 
will see, most of the sampling error in the equalization 
payment comes from the sampling error in the estimate of 
the beneficiary province’s population, and relatively little 
comes from the sampling error in the estimate of the 
standard provinces’ population. 

If symbols with hats represent estimates, then from (2.2), 
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Because stratification is done separately for each 
province, for a beneficiary province p, which is not one of 
the standard provinces, we have, ignoring interprovincial 
migration, Cov(P,, P.,)=0, whereas Povi hs Res 
V(P,) for any of the standard provinces. We can compute 
an approximation by leaving out the last two terms of (2.3): 

A (ce) : 
Pills Nes V (Bek 
ie 

Using data from the 2001 RRC, we can verify that the 
standard deviation of the equalization payment derived from 
(2.4) differs from that derived from (2.3) by no more than 
7%, except for two beneficiary provinces: Newfoundland 
and Labrador, for which the approximation underestimates 
the standard deviation by 11%, and Quebec, for which the 
approximation underestimates the standard deviation by 
12%. 

As we can see from equation (2.4), a sample allocation 
that produces equal variances for beneficiary provinces’ 
population estimates also produces equal variances for 
beneficiary provinces’ equalization payment estimates. 
However, having equal CVs for the beneficiary provinces’ 
population estimates does not guarantee equal CVs for the 
beneficiary provinces’ equalization payment estimates, 
since from equation (2.2), E,, is not directly proportional to 
P,, because K, is not zero. Having equal CVs for the 
beneficiary provinces’ population estimates is still a goal 
worth pursuing, since it ensures confidence intervals of 
equal length for the equalization payment per person. 
Indeed, because of the use of the approximation (2.4), if the 
2001 situation recurs in 2006, the confidence interval for 
Newfoundland and Labrador will be 11% too short (that is, 
the precision for the equalization payment per person will be 
poorer than for other beneficiary provinces), while the 
confidence interval for Quebec will be 12% too long (that is, 
the precision for the equalization payment per person will be 
greater than for other beneficiary provinces). Also, if we 
ignore interprovincial migration, then the provincial 
population estimates are independent and the variance of the 
total equalization payment is minimized if and only if the 
variance of the total population of beneficiary provinces is 
minimized. 

We are attempting to find a provincial sample allocation 
that minimizes the variance of the total equalization 
payment or, equivalently, the variance of the total popu- 
lation of beneficiary provinces (goal III). We also want to 
find a provincial sample allocation that produces equal CVs 
for each beneficiary province’s population estimate (goal 
IV), in order to achieve equally good precision for the 
equalization payment per person. 

Most of the variance in population estimates is due to the 
variance in the undercoverage estimates. If we ignore the 
contribution that overcoverage makes to the variance of the 
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population estimate, then it is easily verified that the 
standard error of the estimated undercoverage rate equals 
the CV of the population estimate. Goals I and II can then 
be restated as follows: minimize the CV of the national 
population estimate, and produce provincial population 
estimates with equal CVs. The difference between goals III 
and I, and between goals IV and II, is that one applies to 
beneficiary provinces, and the other to all provinces. In what 
follows, we will indeed assume that the variance of the 
population estimates equals the variance of the under- 
coverage estimates. 

The goals of the provincial sample allocation are 
summarized in Table 2.1. 


Table 2.1 
The Four Goals of the Provincial Sample Allocation 


Goal Description (equivalent description) 


I Minimize the variance of the estimated nation- 
al undercoverage rate. (Minimize the CV of the 
national population estimate.) 

I Produce equal variances for the provinces’ 
estimated undercoverage rates. (Produce pro- 
vincial population estimates with equal CVs.) 

Ul Minimize the variance of the total equalization 
payment (Minimize the variance of the esti- 
mated total population of beneficiary prov- 
inces). 

IV Produce equal variances for the equalization 
payment per person for each beneficiary prov- 
ince (Produce equal CVs for the population 
estimate for each beneficiary province, or 
produce equal variances for the estimated 
undercoverage rates of the beneficiary prov- 
inces). 


3. Optimal Provincial Sample Allocation 


In this section, we will first describe the notation we plan 
to use, and then we will discuss approximate variance 
formulae for population estimates and estimated under- 
coverage rates. We will explore the issue of optimality with 
respect to the four goals mentioned above. 

Five sample frames are used for the RRC in the 
provinces: the census frame (people enumerated in the 
previous census), the birth frame (intercensal births), the 
immigrant frame (intercensal immigrants), the non- 
permanent resident frame and the “missed” frame. The 
“missed” frame is made up of the sampled persons of the 
previous RRC who were missed by the previous census. 
With their weights, they represent the subpopulation of 
enumerable persons not covered by any of the other four 
frames. Each frame within each province is stratified 
separately. A stratified random sample is selected in each 
frame. All persons from the “missed” frame are included in 
the sample. 
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Let U,,, be the number of undercovered persons in 
stratum / who are classified in province (of classification) p. 
Similarly, let E,,, and O,, be, respectively, the number of 
enumerated and overcovered persons in stratum / who are 


classified in province p, and P,, =U, + £,, —O,,. The 
undercoverage rate for province p can then be written as 
gel sult pss (3.1) 


where U,=)',U,, and P,=),P,,. We see that P, 
equals P, as defined in the preceding section. 
An estimator of the undercoverage rate for province p is 


A 


a) eas (G2) 


where U, and P are estimators of U,, and P,, 
respectively. Linearization gives 


. 1 
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. oe ore 
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The second term in brackets is negligible in comparison 
to the first; therefore, 


“ been, pen G5) 
Vikas) = “ se 
(R,,) pee af 
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where JN, is the size of stratum /, and n, is the sample size 
in stratum h. This ignores the finite population correction 
factor. In what follows, we will assume that there is no non- 
response and that there is only one stratum per province of 
selection (no stratification by frame, age, sex, efc.). This 
assumption will of course be dropped in Section 6, which 
deals with sample allocation to subprovincial strata. To 
compensate for the effects of subprovincial stratification and 
non-response, we introduce a design effect, D,. We assume 
that this design effect varies only with stratum h; in 
particular, the same design effect is used to represent the 
variance of the estimated number of persons selected in 
stratum / who are undercovered in province p, for all p. The 
variance (3.4) can be approximated by 


Dg No aU pe) 


: | 
V(R,)=— > a  *, (3.5) 
= ie > Ny 
and 
m 10 DU, (N, —U 
VU,)= pen ae eh (3.6) 


h=1 Ny, 


where the summation this time is over the provinces of 
selection. 


Goal I: 
From (3.5), we have 
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U,,=>)}U),- This variance of the national estimated 
undercoverage rate will be minimized if 7, 1s proportional 
fo .,|D,U, (N, —U;, ) =N, 40,8, UR, ), where k= 
U,,/N,. Therefore, the optimal allocation for goal I of a 
sample of total size n, 1s 
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This is an improvement over the formula used for the 
2001 RRC (see Clark 2000), where no design effect was 
applied to the part of the sample allocated to provide the 
best Canada-level estimate. In addition, for the 2001 RRC, 
n,, Was proportional to the projected population in province 
p. It makes sense for n, to depend on the size of the 
provincial frames; it should also depend on the provincial 
distribution of the undercoverage. 


p=l,..,10. (3.8) 


Mo dh 


Goal II: 


We can use equation (3.5) to compute the values of 7, 
that yield the same variance for the estimated provincial 
undercoverage rates. That problem has 10 equations in 10 
unknowns. There is also another difficulty: obtaining 
sufficiently precise estimates of the U, for p#h, 
especially if p is a small province. Although in many cases 
it is reasonable to assume that the rate of undercovered 
persons in a small province p, R, =U,/P,, that was 
observed in one census, is a good predictor of the rate in the 
next census, the individual values of the U,, for p#h are 
harder to estimate and still harder to predict. Instead, we will 
assume that U,, =0 for p#h and that U,, =U_,, which 
will mitigate the effect that outliers have on the expected 
variances. The provincial estimates of the undercoverage 
rate will then be of equal variance, if n,, for h=p, is 
proportional to (1/P>)D,U,(N, -U,,)=D,R,(N,/ 
P, —R,,). Therefore, the optimal allocation for goal II of a 
sample of total size n,, 1s 
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Note that in the 2001 RRC, for the part of the sample 
allocated to ensure equal precision of the provincial 


estimates, the sample sizes were set proportional to 
D,R p(-R,) (see Clark 2000). Using V,/P,, instead of 
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1 takes into account not only those units which are in the 
province’s frame and leave the province’s population but 
also those units of the province’s population that are not in 
the province’s frame, leaving the design effect to account 
only for non-response and the sample design. In 2001, 
adjustment for frame units leaving the population was made 
through the design effect, and no adjustment was made for 
population units not in the frame. 


Goal III: 


The estimate of the total population of beneficiary 

provinces has a variance equal to 
10 
foe = VU fee) = pa a Uiven Or 7 Uiven) 
h=l Nj, 

ages U ies = ols and U. ben — 
Tg p are sums over the eight beneficiary provinces (we 
assume that the beneficiary provinces are numbered 
p=1,...,8, and the non-beneficiary provinces are numbered 
p=9, 10). Equation (3.10) is minimized if n,, for 
h=1,...,10, is proportional to JD, Ui.n.(V, —U sven) = 
N, Vv D, Riven (1 Aeeal: where Riven i Oyen! Nye There- 
fore, the optimal allocation for goal III of a sample of total 
SIZE Ny, 1S 
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Note that because units selected in one province can be 
classified in another province, R,.,, and 1,4),, are not 
necessarily zero when p is a non-beneficiary province. 


Goal IV: 


From equation (3.6), we have 


EU ee) 


ys 
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We can use this equation to compute the values of 7, 
that yield the same coefficient of variation for the 
beneficiary provinces’ population estimates. That problem 
has eight equations in eight unknowns. Again here, we have 
a second difficulty: obtaining sufficiently precise estimates 
of the U,,, for p #h, especially ifp is a small province. As 
we did for goal II, we will assume instead that U),, =0 for 
p#h and that U,,=U,. Beneficiary provinces’ 
population estimates will then have equal coefficients of 
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variation if n,, for h=p, is proportional to (1/ P*) 
D,U_,(N, = U,) =D,R,(N,/ P,—R,). Therefore, the 
optimal allocation for goal IV of a sample of total size n,, 
is 


Dit, WM eis _ R,) 
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with the two 
Now = 90, p=9.10. 

It is worth noting that 1, /1,;) 18 constant for all eight 
beneficiary provinces. This shows that goal II (equal 
precision of the estimated provincial undercoverage rates), 
which is a traditional goal of the RRC sample allocation, 
largely overlaps with goal IV (equal precision of the 
beneficiary provinces’ equalization payments per person). 
We will see in Section 5 that n,,/n,, for the eight 
beneficiary provinces, is nearly constant as well. This shows 
that goal I (maximum precision of the estimated national 
undercoverage rate), which is a traditional goal of the RRC 
sample allocation, largely overlaps with goal III (maximum 
precision of the total equalization payments). 


non-beneficiary provinces having 


4. Design Effect 


Standard errors for the 2001 RRC estimates were 
computed using the Generalized Estimation System. Those 
standard errors take into account the RRC’s sampling plan 
and non-response by assuming that the respondents are 
selected with a multi-stage sampling plan. A comparison of 
the standard error derived from (3.6) and the standard error 
computed by the Generalized Estimation System is 
presented in Table 4.1. A design effect equal to the inverse 
of the cube of the response rate for the province of selection 
was used for this comparison. 

The table shows that the standard error for Prince 
Edward Island derived from (3.6) is 39% higher than the 
standard error computed by the GES; this is due to an outlier 
which affects the equation (3.6) estimate more than it affects 
the GES estimate. For most provinces, the equation (3.6) 
standard error is close to the GES standard error. These 
empirical results show that the design effect in equations 
(3.5) and (3.6) is approximately equal to the inverse 
response rate cubed. This suggests that a sample size of “nn” 
units with response rate “r ” yields the equivalent of nxr° 
units rather than the expected mxr, because non- 
respondents are concentrated among persons missed by the 
Census. The GES takes into account the fact that 
undercovered persons are less likely to respond. This 
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decline in precision due to non-response occurs even though 
the actual sampling plan is more efficiently stratified than 
the assumed sampling plan of one stratum per province. 


Table 4.1 
Comparison of Standard Errors 

Standard error Standard error (3.6) 

of under- of under- SE 

IDS coverage coverage / 

Response (response estimate from estimate from GES 

Province rate rate)* (3.6) GES SE 
NL: 0.97 1.08 1,783 1,689 1.06 
Pas 0.97 1.09 1,021 734 1.39 
N.S. 0.95 iS 3,903 3955 0.99 
N.B. 0.96 1.13 3,272 3,229 1.01 
Que. 0.95 ill) TOASTS 19,664 1.01 
Ont. 0.92 1.28 Sig 502 31,602 1.00 
Man. 0.95 1.15 4,762 Sys lilles 0.93 
Sask. 0.96 ie 3,921 3,840 1.02 
Alta. 0.93 25 10,493 10,505 1.00 
B.C. 0.91 1.34 14,619 14,763 0.99 
Can. 0.94 1.20 42,074 42,041 1.00 


There have been no similar studies comparing the design 
effect and the non-response rate in previous RRCs. The 
weight adjustment method used to compensate for non- 
response is different, and the nature of non-response 1s 
significantly different from what it was before 2001. 


5. Final Provincial Sample 
Allocation and Example 


Table 5.1 shows the parameter values that will be used in 
the example. The values of N » are projections of RRC 
frame size for 2006; the other parameters are based on 2001 
RRC data. 

As we might expect, the values of R, ben 1 Ontario and 
Alberta show that few units selected in those two provinces 
are classified as missed by the Census in beneficiary 
provinces. 


Théberge: The 2006 Reverse Record Check Sample Allocation 


The final sample size allocated to province p is simply 


n, =Max(11,Ao1» pn Mpv) P =1,.-,10. 6.1) 


Whether we use the maximum of the four sizes as in 
(5.1), a weighted arithmetic mean, or a weighted geometric 
mean, each method uses four arbitrary parameters (three if 
the total sample size is fixed). For the maximum method, 
higher relative values of n, (or of my, mj, OF My) make 
goal I (II, III or IV respectively) more important. 

Table 5.2 presents an example with n, = 30,000, 
ny, = 64,000, ny, = 25,000 and ny, = 48,078. 

The resulting total sample size is 70,028. Figures in bold 
represent the maximum for the four allocations, 1, . Small 
changes in n,, would affect only the final allocation for 
Quebec. This suggests that with the sample sizes 7,, ny, 
ny, and mn, as chosen above, the final sample size 
allocated to Quebec is dictated by goal III (a precise 
estimate of the total equalization payment). Similarly, the 
final sample size allocated to Ontario is dictated by goal I (a 
precise estimate of the national undercoverage rate). The 
final sample size allocated to Alberta is dictated by goal II 
(equal variances for the provinces’ estimated undercoverage 
rates). The final sample sizes of the other provinces are 
dictated both by goal II and by goal IV (equal precision of 
the estimated equalization payment per person). As noted in 
Section 3, 1,,/7,. 1s constant for all eight beneficiary 
provinces. In the example above, because of the “judicious” 
choice of n,,, the constant is 1. Lowering n,, would 
decrease Alberta’s final sample size, but not that of other 
provinces. We note also that n,,/n,),; does not vary much 
for the eight beneficiary provinces. The addition of goals III 
and IV (relating to equalization payments) allows us to 
control Quebec’s sample size and Alberta’s sample size 
separately. When only goals I and II were used, Quebec’s 
sample size tended to be closely tied to Ontario’s, while 
Alberta’s sample size was closely tied to that of the other 
provinces. 


Table 5.1 


Param 


N 


eter Values 


Pp 


Province Pp D Pp P Pp p. pben 
NTS 551,987 1.0804 524,722 0.0339 0.0464 0.0368 
eat 145,173 1.0882 132,473 0.0334 0.0334 0.0307 
Ns; 995,651 b1527 947,099 0.0492 0.0464 0.0440 
N.B. 797,488 1.1345 736,129 0.0493 0.0466 0.0440 
Que. 8,079,167 1.1740 $7,381,352 0.0510 0.0471 0.0460 
Ont. 13,423,132 P2752 ul. 702797" | 'O.06537"0:0565' 10.00 TF 
Man. 1,262,547 1.1558 1,136,146 0.0466 0.0437 0.0392 
Sask. 1,082,238 Jn 1223 996,562 0.0437 0.0430 0.0402 
Alta. 3,373,128 1.2478 3,010,105 0.0490 0.0403 0.0028 
BiG. 4,570,444 1.3369 4,014,502 0.0761 0.0669 0.0620 
Can. 34,280,955 1.2039 30,581,887 0.0587 0.0524 0.0258 
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Table 5.2 


Provincial Sample Allocation with 
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n, = 30,000, my, = 64,000, m1, = 25,000, and ny, = 48,078 


Province Np All Apt 
N.L. 427 3,816 546 
PEI. 96 3,956 132 
N.S. 796 5,822 1,107 
N.B. 634 5,921 881 
Que. 6 562 6,399 9,262 
Ont. 12,385 9,220 3,148 
Man. 982 5,867 15331 
Sask. 823 5,234 L139 
Alta. 2,622 6,702 1,015 
BC. 4,673 11,063 6,440 
Total 30,000 64,000 25,000 


An allocation method that uses equation (5.1) and a table 
such as Table 5.2 makes it clear why a province’s sample 
has to be a certain size. For example, if we look at the final 
sample allocation in Table 5.2 and decide that 5,867 
observations in Manitoba is insufficient, then we have to 
specify the goal for which they are insufficient. If we want 
to improve on the results for goal II (or goal IV), we also 
have to increase the sample size in all Atlantic provinces 
and all western provinces (or in all Atlantic provinces and 
all western provinces except Alberta). 


6. Subprovincial Sample Allocation 


Although it is evident from equation (3.5) that the 
subprovincial sample allocation in one province of selection 
affects the variances of other provinces’ estimates, we will 
try to optimize the allocation in one province only for that 
province’s estimate. In other words, our problem for each 
province p is to minimize 


3 


hy < jstrata of province Ny 
of selection p 


DU wy (N, rt Uy) 


(6.1) 


subject to the constraint 


en 
h « )strata of province 
of selection p 


p? 


where n,, is a previously determined total sample size for 
province p. Note that the sample size allocated to the 
“missed” frame is fixed, which means that in what follows, 
the “missed” frame strata are ignored, and n, excludes the 
“missed” frame sample size. The solution to that 
minimization problem is 


DU, (N, 20 ,,) 


hp 
: (6.2) 
: Ds DU iy (Ni, — Yip) 
Ve eae of wea 


of selection p 


Np ny Ny! Amn 
3,816 3,816 0.78 
3,956 3,956 Owe 
5,822 5,822 OFZ 
5,921 5,921 0.72 
6,399 9,262 Oral 

0 12,385 3.93 
5,867 5,867 0.74 
5,234 5,234 O72 

0 6,702 DSS 

11,063 11,063 0.73 
48,078 70,028 


for each stratum h’ in province of selection p. 

As we saw in Section 4, there is empirical evidence at the 
provincial level that the factor D, is inversely proportional 
to the cube of the RRC response rate. For the 2001 sample 
allocation, it was assumed that D, varied with the inverse 
of the response rate. To limit the shift of sample, relative to 
2001, from strata with a high response rate, such as census 
frame or birth frame strata, to strata with a low response 
rate, such as immigrant frame or non-permanent resident 
frame strata, we will make D, proportional to the inverse of 
the square of the response rate in stratum h. Note that here, 
in contrast to the assumption we made in Section 3, factor 
D, compensates only for non-response; it does not 
compensate for the stratification since it is defined at the 
stratum level. This is another reason for choosing a factor 
smaller than the inverse of the cube of the response rate. 

As was the case in the 2001 sample allocation, we are 
faced with the problem of reliably projecting the 2006 
values of U,,, and D, for every stratum h. Since the birth 
frame, the immigrant frame and the non-permanent resident 
frame each have only one stratum per province, we plan to 
use the 2006 sizes for those strata and the 2001 
undercoverage rates and response rates, along with some ad 
hoc adjustments for the less populous provinces if 
necessary. A similar procedure can be used for the Indian 
reserve strata of the census frame. The other census frame 
strata are based on sex, marital status (married, not married) 
and age group. For these strata, using the same age groups 
for each sex and each marital status, it would be possible, 
for each province, to rake the national projections to 
margins of provincial projections, and use the raked values 
in equation (6.2). More precisely, to produce projections for 
U,,, for all strata h in province of selection p, we would first 
take the 2001 estimated rates and the 2006 strata sizes and 
compute a projection, for each cell (sex x marital status 
age group), of the number of missed persons, classified in 
the province where they were selected. Those national 
figures could populate the cells of a three-dimensional 
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matrix. Still using the 2001 estimated rates and the 2006 
strata sizes, we would then compute a projection for the 
number of missed persons, classified in province p, in all of 
the province’s strata by sex, then in all of the province’s 
strata by marital status, and finally in all of the province’s 
strata by age group. Those figures would provide the desired 
marginal totals of the three-dimensional matrix. Through 
raking, we could obtain projections for U,,, that add up to 
the desired provincial totals by sex, by marital status and by 
age group. We can avoid convergence problems, simplify 
programming and enhance flexibility if we replace raking; 
we can do so by solving a calibration problem. In fact, we 
need the added flexibility in this case, because the age 
groups for married persons are not the same as the age 
groups for not-married persons. 

Here is an example of how calibration is used. The 
method is based on the following result from Théberge 
(1999). 

If we let U and T be positive diagonal matrices of 
dimension 7 and q respectively, w, a vector of dimension 
n, A aqxn matrix, and b a vector of dimension q, then 
among the weight vectors w of dimension 7 that minimize 
|| Aw —b||;, the unique weight vector that minimizes 
| w— wo lla: is given by 

w=W, 

UAT AU A yer bs Awy). (63) 


where ||z—Z, || 7 =(z- z,)F(z—-z,) 1s a_ weighted 
distance measure between z and z,, and G' is the Moore- 
Penrose inverse of G. 

The equation Aw=b forms the set of g calibration 
constraints. We will set T equal to the identity matrix in 
equation (6.3). If the constraints can be satisfied, then the 
matrix T is irrelevant; if not, then setting T equal to the 
identity matrix has the effect of giving equal importance to 
each of the g constraints when we minimize the distance 
between Aw and b. 

In this case, in projecting the number of missed persons 
in each stratum of a given province, we have A =MX, 
with 


I Gdrevdiny ieee Gig Onc Ou, Oo. OF 60 
OFAO? (OF 20a ROM Maller le eee | 
Lor LS Ee Cree) peers ee sare urn ome () 
Mie) O "0: 0) 00> aes: OC Ose iret. ules 
Aan 0 Ps me 6 am | J 2 PG Pa OO 
OacdenDir OOO Oirnl 9:0, eOee0b20 
Us Ce a Gl ee 
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X rn 0-14 Wen0-14 
XN 15-24 Wen 15-24 
X FN 25—44 Wen 25-44 
by. 
XEN 454 Wen4s5+ b 
M.. 
XPM 25-34 Wr 25-34 
by 
x Ww 
: FM35+ FM35+ 
X = diag , w= , Di= ly ale 
XiVN 0-14 Wyno0-14 b 
0-14 
XVN15-24 Wyn 15-24 p 
15-24 
XiVIN 25-44 WN 25-44 i 
25+ 
X VIN 45+ Wun 45+ 
XM 25-34 WyM25-34 
X WM35+ WM 35+ 


where, for example, xj,,>5_4, 18 the number of missed 
persons, classified in the province where they were selected, 
in the strata of not-married males aged 25 to 44, Wyaiy5_44 1S 
the desired weight for that stratum, and 5, is the number of 
missed persons selected and classified in the province who 
belong to the “not married” strata. All persons aged 0 to 24 
are in “not married” strata regardless of their actual marital 
status. Note that in calculating both the national figures, X, 
and the provincial figures, b, we count only persons who 
did not move from one province to another, so as to remain 
consistent with the objective set out at the beginning of this 
section. 

Continuing the parallel with raking, the matrix X gives 
the values of the three-dimensional matrix to be raked, 
except that the elements are arranged in a diagonal matrix; 
the vector w provides the final “raking factors” that are 
applied to the elements of X to produce the raked values, 
Xw; the constraint is that sums of those raked elements, 
MXw, should be as close as possible to the desired 
“margins” given by the vector b; and w should be as close 
as possible to w, described below. 

By choosing the vector w, so that every element is equal 
to a constant factor, we can scale the national figures down 
to figures that are more appropriate for the province. We can 
do this if we want the weighted national figures to add up to 
the provincial marginal totals, with weights that are as close 
as possible to a constant, in order to preserve the more 
reliable national distribution. The national distribution of 
missed persons may not be appropriate if the distribution of 
strata sizes is not the same for Canada as it is for the 
province. Therefore, a better alternative is to set the w, 
element that corresponds to stratum hh” to 

Wo, =, > Ny» 


heS . 
h 


(6.4) 
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where S'. is the set of the 10 strata (one per province) 
similar to stratum h” (for example, the 10 strata of not- 
married males aged 15 to 24). 

We could remove two _ constraints because _ the 
corresponding rows of M_ are linear combinations of the 
others (for example, the fourth row and the last row), but the 
solution (6.3) is sufficiently general that their removal is 
unnecessary. With A=MX, U=X and T equal to the 
identity matrix, (6.3) simplifies to 


w = w, + M'(MXM’)'(b- MXw,). (6.5) 


The smoothed values for each stratum are the elements of 
the vector Xw. 

A similar problem can arise for non-respondents when 
we want to smooth the sample design’s effects. 


7. Conclusion 


There is much overlap between the two traditional goals 
of RRC sample allocation, which are to obtain a minimum 
variance for the national estimated undercoverage rate (goal 
I) and to obtain equal variances for the estimated provincial 
undercoverage rates (goal II), and the two additional goals 
considered in this paper, which are to minimize the variance 
of the total equalization payment (goal III) and to obtain 
equal CVs for the beneficiary provinces’ population 
estimates (goal IV). Nevertheless, the explicit consideration 
of those two additional goals may allow the sample sizes for 
Quebec and Alberta to vary independently from those of the 
other provinces. The method suggested in this paper to 
achieve a compromise between different allocations that is 
optimal with respect to the various goals, is to take, for each 
province, the maximum sample size over each of the distinct 
allocations. The method provides a more direct justification 
for the allocation. 
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A comparison of the GES standard errors with the 
standard errors derived from the approximation formula 
(3.6) shows for the 2001 RRC, 1 sampled units with a 
response rate of r are equivalent to only nxr° full-response 
units. 

Optimal subprovincial allocation requires smoothing of 
provincial parameters at the age x sex < marital status level. 
Calibration can be a convenient method to scale more stable 
national age x sex x marital status values so that they add up 
to provincial age values, sex values and marital status 
values. The method’s principal goal is reminiscent of the 
principal goal of the raking ratio method, but a solution such 
as the one described in Théberge (1999), which deals with 
the possibility that the constraints may not be satisfied, 
avoids convergence problems. In addition, using the Moore- 
Penrose inverse prevents collinearity problems. 
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Sample Size Calculation for Small-Area Estimation 


Nicholas Tibor Longford ' 


Abstract 


We describe a general approach to setting the sampling design in surveys that are planned for making inferences about small 
areas (sub-domains). The approach requires a specification of the inferential priorities for the areas. Sample size allocation 
schemes are derived first for the direct estimator and then for composite and empirical Bayes estimators. The methods are 
illustrated on an example of planning a survey of the population of Switzerland and estimating the mean or proportion of a 


variable for each of its 26 cantons. 


Key Words: Efficiency; Inferential priority; Sample size allocation; Small-area estimation. 


1. Introduction 


Sampling design is a key device for efficient estimation 
and other forms of inference about a large population when 
the resources available do not permit collecting the relevant 
information from every member of the population. In this 
context, efficiency is interpreted as the optimal combination 
of a sampling design and an estimator of a population quan- 
tity 8. By optimum we understand minimum mean squared 
error, although the development presented in this paper can 
be adapted for other criteria. The pool of the possible 
sampling designs is delimited by the resources, and these 
are usually expressed in terms of a fixed sample size. This is 
not always appropriate because the designs may not entail 
identical average costs per subject. However, within a 
limited range of designs, this issue can be ignored. 

The problem of setting the sampling design for the 
purpose of efficient estimation of a single quantity is well 
understood, and solutions are available for many commonly 
encountered settings. Most of them involve a univariate 
constrained optimisation problem. Setting the sampling 
design for estimating several quantities represents a quan- 
tum leap in complexity, because the problem involves 
several factors, typically one for each quantity. It is essential 
to optimise the design simultaneously for all the factors, 
because the goals of efficient inference about the target 
quantities may be in conflict. For example, in small-area 
estimation, a more generous allocation of the sample size to 
one area has to be compensated by a less generous allo- 
cation to one or several other areas. 

Small-area statistics have become an important research 
topic in survey methods in the last few decades (Fay and 
Herriot 1979; Platek, Rao, Sarndal and Singh 1987; Ghosh 
and Rao (1994), Longford 1999; and Rao 2003), stimulated 
by increasing interest of government agencies, the adver- 
tising and marketing industry and the financial and in- 
surance sector. At present, many large-scale surveys are 


designed for estimating national quantities but, sometimes 
almost as an afterthought, are used for inferences about 
small areas. This would be appropriate if the sampling 
designs optimal for small-area and national inferences were 
similar. We illustrate in this paper that this is not the case 
and that sampling design can be effectively targeted for 
small-area estimation, taking into account the goal of 
efficient estimation of national quantities. To avoid the 
trivial case, we assume that the areas have unequal popu- 
lation sizes. We apply the methods to the problem of 
planning inferences about the 26 cantons of Switzerland; 
their population sizes range from 15,000 (Appenzell- 
Innerrhoden) to 1.23 million (Ziirich). The population of 
Switzerland is 7.26 million. 

Literature on the subject of planning surveys for small- 
area estimation is rather sparse. An important contribution is 
Singh, Gambino and Mantel (1994). In one of the ap- 
proaches they discuss, the planned sample size for the 
Canadian Labor Force Survey is split into two parts. One 
part is allocated optimally for the purpose of national 
(domain) estimation and the remainder optimally for small- 
area estimation. For the latter goal, equal subsample sizes 
are allocated to each area when the areas have equal within- 
area variances, the finite population correction can be 
ignored and the areas have equal survey costs per subject, 
but also when the targets of inference are area-level means. 
When the targets are population totals, equal allocation to 
the areas is not efficient, because it handicaps estimation for 
more populous areas. Even when proportions or rates (per- 
centages) are estimated, the within-area variances depend on 
the population proportion, although the dependence is weak 
when all the proportions are distant from zero and unity. For 
more recent developments in sampling design for small-area 
estimation, see Marker (2001). 

The next section describes the proposed approach based 
on minimising the weighted sum of the sampling variances 
(mean squared errors) of the planned estimators, with the 
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weights specified to reflect the inferential priorities. It is 
applied first to direct estimation of the area-level quantities. 
Then it is extended to incorporate the goal of national 
estimation, and, finally, to composite estimation in section 
3. The concluding section 4 contains a discussion. 

The remainder of this section introduces the notation 
used in the rest of the paper. We assume that area-level 
population quantities @,, d=1, ..., D, are estimated by 
6, with respective mean squared errors (MSE) v, that are 
functions of the within-area subsample sizes n,;v, = 
v,(n,). The overall sample size is denoted by n, and is 
assumed to be fixed. The population sizes are denoted by 
N (overall) and N, (for area d). For brevity, we denote 
n=(n,, ..., Dae Most population quantities © are 
functions of a single variable, such as its mean, total, and the 
like. The variable may be recorded in the survey directly, or 
constructed from one or several such variables. Although 
our development is not restricted to such quantities, the 
motivation is more straightforward with them. An estimator 
of 8, is said to be direct if it is a function of only the 
variable concerned on subjects in area d. 

We assume that each direct estimator considered 1s 
unbiased. This is not particularly restrictive, as most direct 
estimators are naive estimators or are closely related to 
them. We assume that the sample sizes for the areas are 
under the control of the survey designer. This is the case in 
stratified sampling designs in which the strata coincide with 
the areas. In section 4, we discuss sampling designs in 
which such control cannot be exercised; they are 
particularly relevant for divisions of the country into many 
(hundreds of) areas. 


2. Optimal Design for Direct Estimation 


We resolve the conflict between the goals of efficient 
estimation of the area-level quantities 8, by choosing the 
area-level sampling design that minimises the weighted sum 
of the sampling variances (MSEs), 


D 
min, > PiVas (1) 
d= 


subject to the constraint of fixed overall sample size 
n=n'1,;1, is the vector of unities of length D. The 
coefficients P, are called inferential priorities. Greater 
value of P, (in relation to the values P,,, d'#d) implies a 
greater urgency to reduce v,, because the contribution of 
area d to the sum in (1) in magnified more than for the 
other areas. 

The optimisation problem in (1) is solved by the method 
of Lagrange multipliers, or simply by substituting 
n,=n-Nn,-...—N,, So that the problem then involves 
D-—1_ functionally unrelated variables. The solution 
satisfies the condition 
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Ov 
P,—* = const. 
A 


An analytical expression for the optimal subsample sizes 
n, cannot be obtained in general, but when v, =07,/n,, 
as in simple random sampling within areas, the solution is 
proportional to o, YPs , that is, 


ae oP : 
eit Gant, she tan Bo: 


When the within-area variances o7 coincide, o; =...= 
aie =o’, this simplifies further; the optimal sample sizes 
are proportional to aii and do not depend on o?. 

In most contexts, it is difficult to elicit a suitable set of 
priorities P,, and so it is more constructive to propose a 
convenient parametric class of priorities P=(P, ..., P, iy 
and illustrate their impact on the sample size allocation. We 
propose the priorities P,=N§ for O<q<2. For gq=0, 
inference is equally important for every area. With in- 
creasing q, relatively greater importance is ascribed to 
more populous areas. When v,=o7/n,, the optimal 
sample size allocation for g =2, ni =nN,/N, is propor- 
tional to the population sizes in the areas, and so the same 
sampling design is optimal for national and area-level 
inferences. For g>2 the sample size allocation is even 
more generous to the most populous areas, at the expense of 
less populous areas. As this is counterintuitive in the context 
of small-area estimation, the choice of an exponent q > 2 is 
probably never appropriate. A negative priority exponent q 
would be suitable for a survey that aims to focus on the least 
populous areas. Of course, such a design is very inefficient 
for estimating the national quantity 9, especially when the 
areas have widely dispersed population sizes. 

The inferential priorities P, may be functions of 
quantities other than N,. For example, the sizes of certain 
subpopulations of focal interest, such as an ethnic minority 
in the area, may be used instead of V,, P, may be defined 
differently in the country’s regions, or the formula for them 
may be overriden for one or a few areas. 

In some publications of survey analyses, an estimate is 
reported only when it is based on a sufficiently large sample 
size or its coefficient of variation (the ratio of the estimated 
standard error and the estimate) is smaller than a specified 
threshold. If a ‘penalty’ for not reporting a quantity is 
specified, it can be incorporated in the definition of the 
inferential priorities. The difficulty that may arise is that the 
objective function in (1) is discontinuous and the standard 
approaches to its optimisation are no longer applicable. The 
penalty has to be set with care. If it is too low it is 
ineffective; if it is set too high the solution will prefer 
reporting estimates for as many areas as possible, but each 
with sample size or precision that narrowly exceeds the set 


Survey Methodology, June 2006 


threshold. See Marker (2001) for an alternative approach to 
this problem. 

Figure | illustrates the impact of the priority exponent g 
on the sample size allocation for a survey planned in 
Switzerland, with the aim of estimating the population 
means of a variable in its 26 cantons, assuming a common 
within-canton variance o*. The planned overall sample size 
is n=10,000. The curves in either panel connect the 
optimal sample sizes for each exponent g; they are drawn 
on the linear scale (on the left) and on the log scale (on the 
right). The population sizes are marked on the horizontal bar 
at the bottom of each plot. On the log scale, the curves are 
linear. The log scale is useful also because the population 
sizes of the cantons are more evenly distributed on it. 

For g=0, each canton is allocated the same sample 
size, 10,000/26=385, and for g=2 the allocation is 
proportional to the canton’s population size. For inter- 
mediate values of g, sample sizes of the least populous 
cantons are boosted in relation to proportional allocation 
(gq =2), at the expense of reduced allocation to the most 
populous cantons. The subsample sizes depend very little on 
q for cantons with population of about 250,000, 
approximately 3% of the national population size. 


2.1 The Priority for National Estimation 


As the canton-level subsample sizes differ from the 
proportional allocation for priority exponent g < 2, optimal 
canton-level estimation is accompanied by a loss of 
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efficiency of the national estimator. Consider the stratified 
estimator 


of the national mean 0 of a variable, where 6, are 
unbiased estimators of the within-canton means of the same 
variable. Assuming stratified sampling with simple random 
sampling within strata (cantons), with 6 , set to the within- 
stratum sample means, 


2 


See ey cere ; 
var ( nt rece =a — fa) Sa, 


a=) d 


where f, =n, /N,, 1s the finite population correction. 

Figure 2 displays the function that relates the standard 
error ,/var(6) to the priority exponent gq, calculated 
assuming co =100. The standard error is a decreasing 
function of qg; it decreases more steeply at g =0 than at 
gq =2, where it is quite flat. For g =2, the goals of canton- 
level and national estimation are in accord, and 
var (6) =0.100. For q=0, «var(6) =0.143; in this 
setting, optimality of the small-area estimation exerts a 
considerable toll on national estimation, equivalent to 
halving the sample size (0.143/0.100 = J2). For negative 
q, the toll is even greater. 
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Figure 1. The sample size allocation to the Swiss cantons for a range of priority exponents g. The population sizes of the 
cantons are marked on the horizontal bar at the bottom of each plot. 
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Figure 2. The standard error of the national estimator 6 of the 
mean of a variable, as a function of the exponent g 
for priorities of the canton-level estimation. 


Thus, the need for efficiency of the national estimator 
can be addressed by increasing the priority exponent. For 
example, the parties with rival inferential interests may 
negotiate about how much loss in efficiency of 6 can be 
afforded, and the priority exponent would then be set to 
match this loss. Alternatively, this loss may be considered 
by applying the optimal design for area-level estimation. If 
it is regarded as excessive, g is increased until a balance is 
struck between the losses of efficiency for national and 
small-area estimation. 

An unsatisfactory feature of these approaches is that they 
compromise the original purpose of the priorities P— to 
reflect the relative importance of the inferences about the 
distinct small areas. This drawback is addressed by 
associating 6 with a priority, denoted by G, relative to 
small-area estimation, and considering optimal estimation of 
the set of D area-level targets 8, together with the national 
target 6. Thus, we minimise the objective function 


D 
> Piva (ng) + GP.v(n), 


G=i 


where v= var (0) and P= P'l po be factor er 1S 
introduced to ameliorate the effect of the absolute sizes of 
P, and the number of areas on the relative priority G. The 
priorities P, can be interpreted only by their relative sizes, 
as, for any constant c>0, P, and cP, correspond to 
identical sets of priorities for small-area estimation in (1). 

When the sampling design within each area is simple 
random and 6 is the standard stratified estimator, the 
minimum is attained when 
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where P} = P, + GP.N;/N*. The optimal sample sizes for 
the areas are 


ae Cah 
"he. Ge DEpaeaa gt BM 


This corresponds to an adjustment of the priorities P, by 
GP_N;/N’. Note that this adjustment is neither additive 
nor multiplicative. The priority is boosted more for the more 
populous areas. As a consequence, the area-level subsample 
sizes are dispersed more when the relative priority for 
national estimation is incorporated and the area-level 
priorities are unchanged. The finite population correction 
has no impact on n, because it reduces each sampling 
variance v, and v by a quantity that does not depend on n. 

The priority G can be set by insisting that the loss of 
efficiency in estimating the national quantity @ does not 
exceed a given percentage or that at most a few (or none) of 
the absolute differences |P; — P,| or log-ratios |log (P; / P,) | 
are very large. However, the analytical problem is simple to 
solve, so the survey management can be presented by the 
sampling designs that are optimal for a range of values of G. 

The dependence of the subsample size on the exponent 
q and relative priority G is plotted in Figure 3 for the least 
and most populous cantons, Appenzell-Innerrhoden and 
Ziirich, in the respective panels A and C. Panels B and D 
plot the same curves as A and C, respectively, on the log 
scale. Ignoring the goal of national estimation corresponds 
to G =O and ignoring the goal of small-area estimation to 
very large values of G. Throughout, we assume that 
n=10,000 and o* =100, common to all cantons. 

For each exponent g <2, the sample-size curve ,(G) 
decreases for the less populous and increases for the more 
populous cantons toward the proportional representation 
n, =nN,/N, which corresponds to g=2. On the linear 
scale, the increase is quite rapid for Ziirich for small g and 
G, whereas the reduction for Appenzell-Innerrhoden is 
more gradual. As the relative priority G is reduced, the 
excess sample size is re-distributed from Ziirich (and a few 
other populous cantons) to several less populous cantons. 

Figure 4 plots the ‘national’ standard error ,/ var (6) 
under the optimal sample allocation for an array of values of 
q and G. The diagram shows that the standard error of 6 
is reduced radically by a small increase of G_ in the vicinity 
of G =0, whereas for larger values of G it 1s affected only 
slightly. For each G, higher priority exponent gq is 
associated with higher precision of 6. 
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Figure 3. The optimal sample sizes for the direct estimator 6, for combinations of priority exponents g and relative 
priorities G for the least and most populous cantons. 


Ae 3. Composite Estimation 


200 © 
oon ow 


yl tions of the direct small-area and national estimators, 
0 100 200 300 400 


Relative priority G ~ B A 
6, =(1-b,) 6, +b, 6, 
Figure 4. The standard error of the national estimator 
for the allocation that is optimal under an 


array of priorities given by g and G. 


91 


| The resources available for the conduct of a survey are 

‘y ‘| used most effectively by the optimal combination of a 
sampling design and estimator(s), and so the sampling 

i design and (the selection of) the estimator should be, in 
ia | ideal circumstances, optimised simultaneously. This prob- 
lem is difficult to solve formally in most settings, although 
some estimators are more efficient than their competitors in 
a wide range of designs. Composite estimators (Longford 
1999, 2004) are one such class. They are convex combina- 
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with area-specific coefficients 5, that are estimates of the 
optimum. The composition 6, exploits the similarity of the 
areas; it is particularly effective when the areas have a small 
between-area variance on = D=yr6 4 —6)*, where 
6@=D'>,0,. This variance is defined over the D pop- 
ulation quantities @, and is unaffected by the sampling 
design. In practice, o% has to be estimated. When planning 
a survey, estimates from other surveys of the same or a 
related population have to be used, and the uncertainty 
about o;, addressed. This can be done by sensitivity anal- 
ysis, exploring the optimal designs for a range of plausible 
values of 63. 

If the deviations A, =9, —9 were known the optimal 
coefficient 5, in (2) would be, approximately, b, Soy | 
(o;, +n,A:). As A, is not known (otherwise 6, would be 
estimated with high precision by 0+ A,,), we replace Ae 
by its average over the areas, equal to o%, yielding the 
coefficient b, =1/(1+n,,), where o,=06;/67, is the 
variance ratio. The variance o%, also has to be estimated, 
but when there are many areas it is estimated with precision 
much higher than most Ne are. 

If the coefficients b, are estimated with sufficient preci- 
sion the composite estimator 6, is more efficient than the 
two constituent estimators 6 7 and 6. Ignoring the un- 
certainty about the within- and between-area variances, as 
well as the national mean @ and the correlation between the 
national and area-level (direct) estimators, the average MSE 
of 6, is 

2 


AMS yee (3) 
Listens @), 


where ‘aMSE’ denotes the MSE in which A°, is replaced by 
G. its average over the areas. The aMSE in (3) is also an 
approximation to the conditional variance of the EBLUP 
estimator of the area-level mean based on the two-level 
(empirical Bayes) model (Longford 1993, Goldstein 1995, 
Marker 1999, and Rao 2003). See Ghosh and Rao (1994) 
for an authoritative review of application of these models to 
small-area estimation. 

For the composite estimators of the area-level means, we 
search for the sample allocation that minimises the objective 
function 


D 
> P, aMSE (6,) + GP.v. 
d=] 
The solution satisfies the condition 
Ni0,0, p Ni © 


(1 +n,@,) 
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This equation does not have a convenient closed-form 
solution, but iterative schemes can be applied to solve it. 
The value of », determines the remaining sample sizes n,, 
and so optimisation corresponds to a one-dimensional 
search. If the provisional sample sizes n_ based on a set 
value of n, are too large, n' 1, >n, n, is reduced and the 
other sample sizes , are calculated by solving (4). Note 
that the solution depends on the variances 0%, and o%. The 
problem is simplified somewhat when the areas have a 
common variance 6” = 6; =...=6%,. Then the solution of 
(4) depends on the variances only through the ratio 
o= one /o° because o° is a multiplicative factor and has 
no impact on the optimisation. 

By way of an example, suppose g=1 and G=10 in 
planning a survey of the population of Switzerland with 
n=10,000, and m=0.10 is assumed. As the initial 
solution, we use the allocation optimal for direct estimation 
with the same values of g and G. One iteration updates the 
sample size for each canton and, within it, the updating for 
all but the arbitrarily selected reference canton d =1 is also 
iterative. The reference canton’s provisional subsample size 
determines the current value of the constant on the right- 
hand side of (4). Then equation (4) is solved, iteratively, for 
each canton d = 2, ..., D, using the Newton method. In the 
application, the number of these iterations was in single 
digits for each canton. Finally, the subsample size for the 
reference canton is adjusted by the 1/D-multiple of the 
difference between the current total of the subsample sizes 
and the target total n. The updating of the cantons is itself 
iterated, but only a few iterations are required to achieve 
convergence; for example, all the changes in the subsample 
sizes were smaller than 1.0 after three iterations, and smaller 
than 0.01 after eight iterations. The convergence is fast 
because the starting solution is close to the optimum; the 
largest difference between the two subsample sizes is for 
Zirich, 20.0 (from 1199.5 at the start to 1219.5 after eight 
iterations). For Appenzell-Innerrhoden, the sample size is 
reduced from 81.6 to 73.4. Change by less than unity takes 
place for five cantons with population sizes in the range 
228,000—278,000. Note that the subsample sizes would in 
practice be rounded, and possibly adjusted further to 
conform with various survey management constraints. 


No priority for national estimation 


If national estimation has no priority, G=0, equation (4) 
has the explicit solution 


+ nO NE 
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where U‘? = N#’* +...+ N%’*. This allocation is related to 
the allocation n\, d=1,..., D, that is optimal for direct 
estimation of 0, by the identity 


Hence, when qg>0, the allocation optimal for composite 
estimation is more dispersed than for direct estimation. The 
break-even population size is N, =(U‘/D)’'%; areas 
with population sizes N,<N, have smaller subsample 
sizes for composite than for direct estimation, and areas 
with greater population sizes have greater subsample sizes. 
(For g =0, n, =n/D). The amount of extra dispersion is 
inversely proportional to «. 

For o =0, the equations for the optimal sampling design 
lead to a singularity. In this case, each 0, is estimated 
efficiently by the national estimator 6, and so the design 
optimal for composite estimation coincides with the design 
that is optimal for the national estimator (n, =nN,/N). 
For g>0, the optimal allocation yields negative sample 


sizes n, when 
CAPE Td 
N, <| Ee | (5) 


na + D 


This (formal) solution is not meaningful. A negative 
solution should come as no surprise because the aMSE in 
(3) is an analytical function for n, >—1/@,. For small 
@>0, the aMSE is a shallow decreasing function of the 
sample size n,. A negative n, indicates that a (small) 
canton is not worth sampling because of its low inferential 
priority P,. Although additional sample size for a more 
populous canton d’ may yield a smaller reduction of aMSE 
than it would for a small canton d, its impact is magnified 
by the larger priority P,,. 


Positive priority for the national mean 


The aMSE in (3) ignores the uncertainty about the 
national mean 09, and this becomes acute when one of the 
cantons is not represented in the sample. This deficiency of 
(3) can be compensated for by setting the relative priority 
G toa positive value. 

Figure 5 summarises the impact of the relative priority 
G and the priority exponent g on the optimal sample sizes 
of the least and most populous cantons, together with canton 
Thurgau which has the 13" (median) largest population size, 
228,000. Each setting of g, indicated in the title, and G, 


93 


using different line types, is represented for a canton by a 
graph of the optimal sample size as a function of the 
variance ratio @. The limit of this function for w— +0, 
equal to the sample size optimal for direct estimation, is 
marked by a bar at the right-hand margin of the panel. For 
@=0, the sampling design optimal for estimation of the 
national mean 0 is obtained. Panels A and B at the top are 
for the overall sample size » =10,000 and panels C and D 
for n = 1,000. 

The diagram shows that the optimal sample sizes are 
nearly constant in the range we(w, +); @ increases 
with g, G and 1/n. This is a consequence of the relatively 
large sample size n, which ensures that the subsamples of 
most cantons are too large for any substantial borrowing of 
strength across the cantons to take place, unless the cantons 
are very similar (@<w ). Most shrinkage coefficients 
b, =1/+n,@) are very small. When n=10,000 is 
planned, for small values of , the optimal sample size 
increases steeply for the least populous canton and drops 
precipitously for the most populous canton. Dispersion of 
the optimal sample sizes increases with g and G, 
converging to the optimal allocation for estimating the 
national mean 9, which corresponds to wm =0. In contrast, 
the optimal sample sizes are discontinuous at @=0 when 
G =0; the solutions diverge to —oo for the least populous 
cantons. 

In panels C and D, for n =1,000, the dependence of the 
sample sizes on @ persists over a wider range of @ 
because there is a greater scope for borrowing strength 
across the cantons with the smaller sample sizes. The 
optimal sample sizes are not monotone functions of ; for 
the least populous cantons there is a dip at small values of 
w. The dip is more pronounced for small G and large g, 
that is, when the disparities of the cantons’ priorities are 
greater and inference about the national mean is relatively 
unimportant. This phenomenon, somewhat exaggerated by 
the log-scale of the vertical axis, is similar to the case 
discussed for G=0. Because of the disparity in the 
priorities P,, a small reduction of aMSE for a more 
populous canton is preferred to a greater reduction for a less 
populous canton. The dip is present also when n = 10,000, 
but it is so shallow and narrow as to be invisible with the 
resolution of the graph. Note that the horizontal axes in 
panels C and D have three times wider range of values of 
than in panels A and B. 

In the context of the planned survey, it was agreed that 
@ is unlikely to be smaller than 0.05. Therefore, the sample 
size calculations could be based on the direct estimator. 
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Figure 5.The sample sizes optimal for composite estimation of the population means for three cantons for a range of 
variance ratios @, priority exponents g=0.5 and g=1.0 and relative priorities G=1,10 and 100. The 
overall sample sizes are 10,000 (panels A and B) and 1,000 (panels C and D). 


4. Discussion 


The method described in this paper identifies the optimal 
design for the artificial setting of stratified sampling with 
simple random sampling within homoscedastic strata. 
Specifying the priorities for small-area and national esti- 
mation is a key element of the method. In practice, the 
priorities may be difficult to agree on, and some of the 
assumptions made may be problematic, the assumptions of 
equal within-stratum variances and simple random sampling 
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in particular. The method can be extended to more complex 
estimators, but then the values of further parameters are 
required. A more constructive approach regards the optimal 
sampling design for the simplified setting as an approx- 
imation to the sampling design that is optimal for the more 
realistic setting. Even if the optimal sampling design were 
identified, it could not be implemented literally, because of 
imperfections in the sampling frame and (possibly) infor- 
mative and unevenly distributed nonresponse. However, the 
approach can be applied, in principle, to any small-area 
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estimator that has an analytical expression for the exact or 
approximate MSE. This includes all estimators based on 
empirical Bayes models, to which the composite estimator 
is closely related. Sampling weights can be incorporated in 
sample size calculation if they, or their within-area 
distributions, are known, subject to some approximation, in 
advance. Sample size calculation for a single (national) 
quantity entails the same problem. 

Although the numerical solution of the problem for 
composite estimation with a positive priority G is simple 
and involves no convergence problems, it is advantageous 
to have an analytical solution, so that a range of scenarios 
can be explored. The proximity of the solutions for the 
direct and composite estimation suggests that the allocation 
optimal for direct estimation may be close to optimum also 
for composite estimation with realistic values of @, say, 
o> 0.05. 

Various management and organisational constraints are 
another obstacle to the literal implementation of an analyt- 
ically derived sampling design. In household surveys, it is 
often preferable to assign an (almost) full quota of addresses 
to each interviewer, and so sample sizes that are multiples of 
the quota are preferred. These and numerous other con- 
straints can be incorporated in the optimization problem, 
although they are often difficult to quantify or the designer 
may not be aware of them because of imperfect communi- 
cation. Improvisation, after obtaining the sampling design 
that is optimal for a simpler setting, may be more practical. 
Also, priorities, or expert opinion about them, may change 
over time, even while the survey is being conducted and 
analysed. Estimates that are associated with standard errors 
or coefficients of variation greater than a specified threshold 
are often excluded from analysis reports. Intention to do this 
can be reflected in sample size calculation by regarding 0 
as the estimator of @,, that is, by setting the associated 
MSE to the corresponding aMSE o3+var(6) or to 
another (large) constant. 

Although we propose a particular class of priorities for 
the small areas, no conceptual difficulties arise when 
another class is used instead. It may depend on several 
population quantities, not only the population size. In 
principle, the priorities can also be set for the areas individ- 
ually, although this is practical only when the number of 
areas is small. The formula-based and individually set 
priorities can be combined by adjusting the priorities, such 
as P, = N4, for a few areas to reflect their exceptional role 
in the analysis. 

Sensitivity analysis, exploring how the sampling design 
is changed as a result of altered input, is essential for 
understanding the impact of uncertainty about the estimated 
parameters (the variance ratio @ in particular) and the 
arbitrariness, however limited, in how the priorities are set. 
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For this, an analytically simple solution that can be executed 
many times, for a range of settings, is preferred to a more 
complex solution, the properties of which are more difficult 
to explore. 

Multivariate composite estimators exploit the similarity 
not only across areas, but also across (auxiliary) variables, 
time, subpopulations, and the like (Longford 1999 and 
2005). The aMSEs of these estimators depend on the scaled 
variance matrix Q, the multivariate counterpart of o. 
Sample size calculation for this method is difficult to 
implement directly because both variances and covariances 
in Q are essential to the efficiency of the estimators. A 
more constructive approach matches the matrix Q with a 
ratio @ that can be interpreted as the similarity of the areas 
after adjusting for the auxiliary information, as in empirical 
Bayes methods. 

When control over the sample sizes allocated to the areas 
is not possible sample size calculation is still meaningful as 
a guide for how the sample sizes should be allocated on 
average. In general, a unit reduction of the sample size is 
associated with greater loss of precision than a unit increase. 
Therefore, designs in which the sampling (replication) 
variance of the subsample sizes n,(d fixed) is smaller are 
better suited for small-area estimation. In designs with large 
clusters, such variances are large because, at an extreme, an 
area may not be represented in the survey in some 
replications and may be over-represented several times in 
others. Using smaller clusters is in general preferable for 
small-area estimation if this does not inflate the survey costs 
and a fixed overall sample size can be maintained. 
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Small Area Estimation Using Area Level Models and 
Estimated Sampling Variances 


Yong You and Beatrice Chapman ' 


Abstract 


In small area estimation, area level models such as the Fay—Herriot model (Fay and Herriot 1979) are widely used to obtain 
efficient model-based estimators for small areas. The sampling error variances are customarily assumed to be known in the 
model. In this paper we consider the situation where the sampling error variances are estimated individually by direct 
estimators. A full hierarchical Bayes (HB) model is constructed for the direct survey estimators and the sampling error 
variances estimators. The Gibbs sampling method is employed to obtain the small area HB estimators. The proposed HB 
approach automatically takes account of the extra uncertainty of estimating the sampling error variances, especially when 
the area-specific sample sizes are small. We compare the proposed HB model with the Fay—Herriot model through analysis 
of two survey data sets. Our results have shown that the proposed HB estimators perform quite well compared to the direct 
estimates. We also discussed the problem of priors on the variance components. 


Key Words: Gibbs sampling; Hierarchical Bayes; Prior sensitivity; Sample size; Variance components. 


1. Introduction 


Sample surveys, for most purposes, are usually designed 
to provide reliable direct estimates for total populations and 
large areas by using area-specific sample data. These direct 
estimates frequently fail to provide reliable estimates for 
small areas due to very small sample sizes in the areas. 
Since small area estimates often have unsuitably large 
standard errors, to gain precision and reliability it is 
necessary to “borrow strength” from related areas thus 
increasing the effective sample size to construct indirect 
estimates for the small areas (Rao 1999). Explicit model- 
based methods that use supplementary data such as census 
and administrative data associated with the small areas in 
explicit models to link the small areas have been widely 
used in practice to obtain reliable model-based estimators. 
There are two broad classifications for these models: area 
level models and unit level models. Area level models are 
based on area direct survey estimators and unit level models 
are based on individual observations in the areas. For 
overviews and appraisals of models for small area 
estimation, see Rao (1999, 2003). In this paper we study 
area level models. 

To obtain a basic area level model we assume that the 
small area parameter of interest 0, is related to area-specific 
auxiliary data x; =(x;,..., x;,)’ through a linear model 

era ook be a aye el DiS a (7 (1) 


where m is the number of small areas, 8 = (B,,...,8,,)' 1s 
the p x1 vector of regression coefficients, and the v,’s are 
area-specific random effects assumed to be independent 
and identically distributed (iid) with E(v,)=0 and 
var(v,) = 67. The assumption of normality may also be 


included. This model is referred to as a linking model for 
OF 
The basic area level model also assumes that given the 
area-specific sample size n, >1, there exists a direct survey 
estimator y, (usually design unbiased) for the small area 


parameter 0, such that 
yi O te = 1), m:; (2) 


where the e, is the sampling error associated with the direct 
estimator y,. We also assume are that the e,’s are inde- 
pendent normal random variables with mean E(e, | 0;) = 0 
and sampling variance var(e, | 9,) =o;. Combining models 
(1) and (2) lead to a linear mixed area level model 


a= Kepee ves oi = lok. (3) 


The well-known Fay—Herriot model (Fay and Herriot 1979) 
in small area estimation has the form of model (3) with the 
sampling variance o; assumed to be known in the model. 
This is a very strong assumption. Usually a smoothed 
estimator of co? is used in the model and then treated as 
known. In this paper, we consider the situation where the 
sampling variances o; are unknown and are estimated by 
unbiased estimators s°. Following Rivest and Vandal 
(2002) and Wang and Fuller (2003), we assume that the 
estimators s? are independent of the direct survey estima- 
tors y, and s? has a sampling distribution d,s; ~ 07 Wn 
where d, =n, —1 and n, is the sample size for the i" area. 
For example, suppose we have n, observations from small 
area i and these observations are iid N(u,,0°). Let y, be 
the sample mean of the n, observations. Then jy, ~ 
N(u,;,0;) and o; =o7/n;. Then we can obtain a direct 
estimator of o; as s?=t;/n,, where t; is the sample 
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variance of the n, observations. Also y, and s; are 
independent and (n, —1)s? ~ 07 es 

We are interested in estimating the small area parameters 
§.. Rivest and Vandal (2002) and Wang and Fuller (2003) 
obtained the empirical best linear unbiased prediction 
(EBLUP) estimators of 8, and the associated mean square 
error (MSE) approximations assuming that m and n, are 
relatively large. In this paper, we consider a hierarchical 
Bayes (HB) approach using the Gibbs sampling method. An 
advantage of the HB approach is that it is straightforward, 
and the inferences for parameters 0, are “exact” unlike the 
EBLUP approach. The small area parameter 0, is estimated 
by its posterior mean and its precision is measured by its 
posterior variance. The HB approach automatically takes 
account of the uncertainties associated with unknown 
parameters in the model. Section 2 presents the HB area 
level models and related Gibbs sampling inferences. Section 
3 presents two survey data analysis and sensitivity analysis. 
And finally in section 4, we offer some conclusions and 
future work directions. 


2. Hierarchical Bayes Approach 
We now present the area level model (3) and the 


estimated sampling variances s’ in a HB framework as 
follows: 


Model 1 
: = VGso, sind NCE. ON) ian, up 
s ¢ djs lio ppuindiay Yea diag bgt Vest 


2 

a) 0 Bae setind Nd Bos ia aNee a: 

- Priors for the parameters: 1($) 1, n(o- ) ~ 
IG(a,,b,),i=1, ..., m, ™(o2) ~IG(ay, by), where 
a;,b, (0<i<m) are chosen to be very small known 
constants to reflect vague knowledge on o? and ox. 
IG denotes the inverse gamma distribution. 


In Model 1, the sampling variances o* are unknown. In 
practice however, we may have a simpler model by 
replacing o; by its estimate s? (here s, is treated as a 
constant) and obtain the following model: 

Model 2 

+ 1, bOpeindiN(6)6, =e a Sy wees 
- 0,}B, 0, ~ind N(x! B, o>), i=1,...,m; 
- Priors: 2(B) <1, 2(o,) ~ IG(ay, bp). 

Model 2 is actually the Fay-Herriot model with sampling 
variances known as s;. If area-specific sample sizes n, are 
small, using s7 in Model 2 may lead to underestimation of 


the MSE under the EBLUP approach or the posterior 
variance under the HB approach. We are interested in 
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evaluating the effects of using s; for o; in the model. We 
will obtain the HB estimates of 8, under both Model 1 and 
Model 2 and compare the HB estimates through real survey 
data analysis. 

Under the HB approach, we use the posterior mean 
E(8,|y) as a point estimate for 8, and the posterior 
variance V(0,|y)as a measure of variability, where y= 
()15--->¥m)- To estimate E(8;|y) and V(0;|y), we 
employ the Gibbs sampling method (Gelfand and Smith 
1990). From Model 1, we obtain the following full condi- 
tional distributions for the Gibbs sampler: 


[9, ly; B, S o.]~ Ny; vei ch Oca ee be B, He 3. ), where 


+s, 
° [a7 |y, 0, B, o-]~IG 
0; -6,)’ +d,s; 
p4 
where d,=n,—-1, i=1,...,.m; 
m 
Ay igs 


” [o7 | y, 8, B, o7 ]~ IG . 


m 


+0, aX, B)? 


It is straight forward to draw samples from these full 
conditional distributions. For implementations, we use L = 5 
parallel runs each with a “burn-in” length of B = 1,000 and 
Gibbs sampling size of G = 5,000. The prior parameters a,, 
b, and ay, b, are chosen to 0.0001. The HB estimator of 0, 
under Model | is thus obtained as 

x LG 
0° =(LG)" DTD Py, +779) 4 B®), 4) 
l=1 g=l 
where 2 = 628 /(g2® 4 28) 
variance of 8, can be estimated by 


V(0,) = (LGTY (p02) 


l=1 g=1 


1 Bes 
+ (LADY (Yi y, + dy )x, B®)? 


[Fs Vicferes| 


2 
~ joy" Ty (yy, +(1- xp) FES) 


tbe 


and the posterior 
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where {pies er Cae ees. anGs Pete 26, by tasithé 
sample generated from the Gibbs sampler. The estimators 
(4) and (5) are the so-called Rao-Blackwellized HB 
estimators. The Rao—Blackwellized estimators are more 
stable in terms of simulation errors as shown, for example, 
in Gelfand and Smith (1991) and You and Rao (2000). 

Now we consider Model 2. The full conditional distribu- 
tions for the Gibbs sampler under Model 2 are 


- [0,|¥,B,0.]~ Ny, ¥, + -y,)x! B, y; 57), where 


3 [Bly, 8, 0,]~ N, 


0 +2, by 

. [oz |y, 8, BJ~IG ie 

+5 0, — x;B)° 
i=l 


Under Model 2, the HB estimator of 9, and the 
corresponding posterior variance estimator are given by (4) 
and (5) respectively with o?"® replaced by s;7. Note that 
using s; instead of o7"® may lead to severe under- 
estimation of the posterior variance of 9, for some areas 
with small sample sizes n,. We will compare the HB 
estimators and evaluate the effects of using s; in Model 2 
through data analysis in the following section. 


3. Data Analysis 


3.1 The Data Sets 


We consider two interesting data sets in our analysis. The 
first data set is corn and soybean data with only 8 areas and 
small sample sizes in each area. The second data set is milk 
data with 43 areas and relatively large sample sizes in each 
area. We will compare the HB models and estimates based 
on these two data sets. 


Corn and Soybean Data: The corn and soybean data comes 
from the U.S. Department of Agriculture and was first 
studied by Battese, Harter and Fuller (1988). The data 
contains reported crop hectares and LANDSAT satellite 
data for corn and soybeans in sample segments of 12 Iowa 
counties. The reported number of hectares for each crop 
comprise the direct survey estimates. Used as auxiliary data 
are the population means of number of pixels of a given 
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crop per segment. The sample sizes are small for these 
areas, ranging from 1—5. For our purposes only the counties 
with a sample size of 3 and greater are used (8 areas meet 
the criteria). Therefore of the included counties the sample 
sizes range from 3-5. The original data is unit level data. In 
order to have area level data the sample mean and the 
sample standard error are calculated for each county. The 
sample standard errors for the corn and soybean data are 
quite large in general (yielding some CVs in the 0.3-0.4 
range and one CV of 0.532) but by chance there are also 
some small values in some instances (for corn data, Franklin 
has standard error 5.704 and CV 0.036). Because the sample 
sizes are so small, these sample standard errors cannot be 
trusted to approximate the true standard errors. Table 1 
presents the modified area level data for corn and soybeans 
from the unit level data of Battese et al. (1988). 


Table 1 
Modified Crop Area Level Data, from 
Battese, Harter and Fuller (1988) 


Corn Soybeans 
County N; Vi SD CV Vi SD CV 
Franklin 3:5) 1581623 15.70495 01036. ~ 52473. 16.425. 03313 
Pocahontas 3 102.523 43.406 0.423 118.697 50.290 0.424 
Winnebago 3  MOW78 305470) 0271 88.573 10.453 0.118 
Wright 3 144.297 53.999 0.374 97.800 52.034 0.532 
Webster 4 117.595 21.298 0.181 112.980 23.531 0.208 
Hancock 5 109.382 15.661 0.143 117.478 17.209 0.146 
Kossuth S$ 110.252 12.112 0.110 117.844 20.954 0.178 
Hardin 5 120.054 36.807 0.307 101.834 26.790 0.263 


Milk Data: The milk data, used in an article by Arora and 
Lahiri (1997), comes from the U.S. Bureau of Labor 
Statistics. The estimated values are the average expenditure 
on fresh milk for the year 1989. There is data for 43 areas 
with sample sizes ranging from 95 to 633. The CVs range 
from 0.074 to 0.341 over the 43 areas. A more detailed 
description of the data can be found in Arora and Lahiri 
(1997). For completeness, we give the data in Table 2. 
Following Arora and Lahiri (1997), we use x;B=8, if 
ie j‘ major area, a collection of similar publication areas. 
Arora and Lahiri (1997) used eight major areas. Since this 
division of the eight major areas is not given in their paper, 
after noting trends in the data we used the Fay-Herriot 
model to test two new divisions of 6 and 4 major areas that 
combine similar survey estimates. These major areas 
produced large CV reduction in general. Where the 6 groups 
had yielded an average CV reduction of about 20% the 4 
groups gave approximately an average 25% CV reduction 
over the direct estimates. Comparison of the point estimates 
and CVs have shown that the 4 major areas perform better 
than the 6 major areas. The 4 major areas are 1-7, 8-14, 
15-25 and 26-43. In this paper, we will use these 4 groups 
as auxiliary variables for illustration purpose only. 
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Table 2 
Milk Data, from Arora and Lahin (1997) 
Small 

Area ni; y; SD CV 

1 191 L099 0.163 0.148 

2 633 1.075 0.080 0.074 

3 597 1.105 0.083 0.075 

4 en 0.628 0.109 0.174 

5 195 0.753 0.119 0.158 

6 191 0.981 0.141 0.144 

7 183 L257 0.202 0.161 

8 188 1.095 On 7 0.116 

9 204 1.405 0.168 0.120 
10 188 1.356 0.178 0.131 
1] 149 0.615 0.100 0.163 
12 290 1.460 0.201 0.138 
13 250 1.338 0.148 O.144 
14 194 0.854 0.143 0.167 
15 184 UTI6 0.149 0.127 
16 193 fev 0.145 0.131 
17 218 251 0.135 0.107 
18 266 1.430 Ons2 0.120 
19 214 1.278 0.137 0.107 
20 213 1.292 0.163 0.126 
oA 196 1.002 0.125 0.125 
pips 95 1.183 0.247 0.209 
23 195 1.044 0.140 0.134 
24 187 1.267 0.171 0.135 
25 479 1.193 0.106 0.089 
26 230 0.791 0121 0.153 
2a 186 0.795 0.121 0.152 
28 199 0.759 0.259 0.341 
29 238 0.796 0.106 0.133 
30 207 0.565 0.089 0.158 
31 165 0.886 O;225 0.254 
32 153 0.952 0.205 0.215 
33 210 0.807 0.119 0.147 
34 383 0.582 0.067 O15 
BS 29 0.684 0.106 ORS 5 
36 226 0.787 0.126 0.160 
37 224 0.440 0.092 0.209 
38 212 0.759 0.132 0.174 
39 21} 0.770 0.100 0.130 
40 179 0.800 0.113 0.141 
4] 312 0.756 0.083 0.110 
42 241 0.865 0.121 0.140 
43 205 0.640 0.129 0.202 


3.2 Analysis of Results 


Corn and Soybean Data: First we consider the effect of our 
treatment of o; using the HB approach. Table 3 presents 
the HB estimates 68 and the associated standard errors 
(SDs) and CVs for the small area corn and soybean data 
sets. The SD is the square root of the posterior variance. 
Under Model 1 (o; unknown), the SDs and CVs are 
consistently larger than the corresponding SDs and CVs 
under Model 2 (07 =s; known). The increased SDs and 
CVs of Model 1 are expected since this model takes into 
account the added variability of estimating o7. On average 
there is about 20% increase in SDs and CVs (this calcu- 
lation excludes Franklin for corn data). The results support 
the fact that letting o? =s7, the known direct estimate of 
ora leads to underestimation of the SD and CV of 0. 
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Inspection of small areas Franklin and Webster for the corn 
data and county Winnebago for the soybean data establish 
in some cases where the sampling errors by chance are quite 
small this under estimation is severe. 

Comparison of the HB estimates under Model 1 and 
Model 2 to the direct estimates can be made using the CVs 
in Table 1 and Table 3. Under Model 2 the HB estimates 
have smaller CVs than the direct estimates in 6 of the 8 
counties for the corn data and similarly for the soybean data, 
6 out of 8 counties. Of the remaining 2 counties for each 
crop, the CVs under Model 2 are the same as the direct 
survey CVs or only slightly larger. Estimators from Model 2 
therefore seem to have gained efficiency compared to the 
direct survey estimators. Now examining the HB estimates 
under Model | and the direct survey estimates lead to mixed 
results for the corn and soybean data sets. Model 1 accounts 
for the added uncertainty of estimating the sampling 
variances and so in only 4 of the 8 counties the HB 
estimates show improvements in efficiency for the corn 
data. For the soybean data 5 out of 8 counties demonstrate 
the HB estimates as improvements on the direct survey 
CVs. For the remaining counties the direct estimates exhibit 
lower CVs and even substantially lower CVs in some cases. 
For the corn data, counties Franklin and Webster have CV 
increases with Model 1 of more than 0.09 and 0.12 
respectively. As well for the soybean data, county 
Winnebago has a CV increase of almost 0.10 from the direct 
survey estimate, using Model 1. Areas where the direct 
estimates demonstrate smaller CVs compared to the HB 
estimates include a number of those areas where the CVs 
are by chance atypically small. So the increased model- 
based CVs may reflect more appropriate CVs for those 
areas. Of the 7 cases where the direct CVs are smaller 
compared to the HB CVs under Model 1, the 3 cases noted 
above have severe differences and the remaining 4 instances 
show only slight reduction in efficiency with use of Model 
1. Since direct survey estimates quite often have 
unacceptably large CVs and yet still by chance may have 
CVs grossly and inexplicably small, HB estimation under 
Model 1 may be more reliable and reasonable by taking into 
consideration the uncertainty of estimating o. 


Milk data: Table 4 contains the HB estimates for the milk 
data. As expected, over the 43 areas the treatment of co? as 
known or unknown shows negligible differences in terms of 
point estimates, SDs and CVs due to the large sample sizes 
in the 43 areas. Therefore the substitution of 6; =.s? in the 
model is reasonable when the area-specific sample sizes are 
large, as clearly shown in this example. Also the HB 
estimates give reduced SDs and CVs when compared to the 
direct survey estimates in Table 2. As would be expected, 
the HB estimation approach is thus an improvement on the 
direct survey estimates. 
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Table 3 3.3. Priors and Sensitivity Analysis 
Comparison of HB Estimates for Crop Data . . 
P P In Model 1, the sampling variances o? are assumed to 
o; known (07 = s/) oj unknown be independent with inverse gamma prior distribution 
4 HB 4, HB ; : 
County 0; SD nO ay sD CV IG(a,,b,), and the model variance o? also has inverse 
Corn ; ‘ : : 
Franklin «155.788 6.061 0.039 142.862 18.408 0.129 gamma prior distribution IG(a),,), where a, b; 
Pocahontas 100.813 28.297 0.281 91.560 32.420 0.356 (0<i<™m) are chosen to be very small known constants to 
Winnebago 115.337 28.406 0.246 113.130 35.207 0.311 2 2 
Wright 131.630 28345 0.215 123.547 30.764 0.250 reflect vague knowledge on o; and o,. So we have used 
Webster 109.030 20.634 0.189 97.856 29.834 0.307 proper priors to avoid the problem of any improper 
Hancock 121.682 15.656 0.129 123.478 17.857 0.145 posteriors. One may consider using flat priors for o? and 
Kossuth 115.710 11.180 0.097 114.910 12.510 0.109 ees ‘ ; ees 
Hardin 135.626 23.228 0.171 135.178 23.804 0.176 o,, Le, mMo;)cl, and n(o,)o1, similar to the flat 
Soybean prior on 8. With the flat priors on o7 and o?, the full 
Franklin 75.375 16.272 0.216 88.186 21.067 0.239 Pipeline i terest dicey aia ae 
Pocahontas 116.943 27.031 0.231 109.052 30.098 0.276 conditional distributions tor 6; and o,, are given as 
Winnebago 87.525 10.304 0.118 88.053 18.854 0.214 ; : 
Wright 104.184 23.671 0.227 105.825 24.497 0.232 214 6.8.621~1G (4 em baal aah aii ie 
Webster «115.510 20.789 0.180 109.455 25.801 0.236 [o; | y,9;B, 0%] ten 
Hancock 101.368 15.741 0.155 102.876 17311 0.169 2 2 
Kossuth 102.388 14.948 0.146 101.862 15.019 0.148 
Hardin 87.455 17.774 0.203 93.397 20.251 0.217 and 
Table 4 2 2 a ee ae 
Comparison of HB Estimates for Milk Data lo riay, OiBFOs}= IG ee > zo me 3) ll 
Ve 
Saal o? known (c? =57) o? unknown 
reno) SD CV oe SD CV The implementation of the Gibbs sampler under the flat 
ee 0200 01139? oy 0A 1,021" “SO1117T 40:109 priors is also straightforward. However, the flat priors on 
2 1045 0.072 0.069 1.045 0.071 0.068 2 2 ; alee 
cn Oc ccotee cesar cues 5; and o* may lead to improper posteriors if the sample 
42076) GO00SSi = 0024 10.770NI 20096 910,125 sizes and the number of small areas are small. In order to 
5 0849 0.096 0113 0852 0.096 0.113 2 
see the problem on o; more clearly, we can study the 
6 0975 0.103 0106 0975 0.102 0.105 P L a y 
7 Waossiee O.125)0%.018 1,055) 1.0125 © 40.118 Model 1 in two steps. First, we can obtain the posterior of 
8 1.097 0.099 0.090 1.096 0.099 0.090 o> given its direct estimate s; as 
T1219", 012) 0,099 "1215" 0.121 ~~. 0.100 
LOMMOII 92, SRO “O02! V1.19G Wi2F O7102 Say 2 2) 22 2 
11 0.793 0.094 0119 0.799 0097 0.122 mG; | 5; De (5; 19; )-m(G;) 
elie Ole KON08 6 | 12095 5 O10. 0.107 25 = dp? seeming i Diifim er merae? 
1S Wpz66 0.119" 0.093 a3! T Lott WO .093 07) exp{—o; djs; /2}- TCG; ). 
14 0.984 0.107 0.109 0.987 0.107 0.109 F 
Lee F187 9 10.105, _ 0.088 1.187 0.104 0.087 By assuming a flat prior 1(o; ) oc 1, we can obtain 
16 1.156 0.104 0.090 1.156 0.102 0.089 
itil 2252 “HO.10UeNO083 ELL1.2251) < 0.100he:) 40.088 Sig d. ds? 
18 1.284 = 0.115, 0.089.-s«1.281 = 0.113 0.088 GAS, jig ir — al |, 
ioretise OOF 0.082 1.235 0.100 0.081 2 2 
20: 78 283 MMOS Tomson a1s3hAT ON 10s nnI089 
21 1.092 0.097 0.089 1.095 0.098 — 0.089 : . 
oe Tio be” OIGT Ties 0 Ler” OG lGe provided that d, Oe ot g Be Then we can use this 
235 SIZ M039 MEOOS2 BIAS” 2011039 "0051 proper IG posterior m(o; |s;) as an informative prior for 
A eli 2OLD Dec O 113i! % 0092 eee 220m 0.4 Nile prey 0:00 Dy ae i 2 ; 
25 1.193 0086 0072 1193 0.086 0.072 o; inthe sampling model y,|0;,0; ~ind N(®;,0; ). This 
Dorrrorol! oor e07120. "$0762" 6091 0:106 will ensure to have proper posterior inference. For the 
Be ee a ee modified corn and soybean data, using flat priors on o; will 
Penh D125 D170. | 0732 O23 siete 0.169 ee: 
29° 0.768 0.085 0.110 04767. 0.085 0.110 lead to improper posterior due to the small sample sizes 
30, 0.615 0.076 0.124 0.618 0.076 0.123 (n, =3) for some areas. Thus, proper inverse gamma priors 
31, 20769 0122 0158 . (0767 0.120 10,456 foo era 
32 0795 0119 0.150 0792 40118 0148 are used in the data analysis to ensure that all the posteriors 
33. 0.771 0.091 0.118 0.770 = 0.090 0.117 are proper, as commonly used in the HB small area 
34 0.612 0.060 0.099 0613 0.062 0.100 Pa yon ae ce 
35° 0701 008  O121 0701 0.084 0120 estimation in practice (e.g., Arora and Lahiri 1997; Datta, 
36 60.757 = (0.094. —Ss«0.123 0.759 0.093 0.123 Lahiri, Maiti and Lu 1999; You and Rao 2000; Rao 2003). 
Tee is54. 40.080 050 M0. 538 * 00st 0.151 
PE eee LP ie ae be Hence we do not face the problem of some posteriors being 
39 0.754 0.082 0.108 0.753 0.082 0.108 improper, since correct HB inference should be based on 
a ae a ee proper posteriors. Under Model 2 with the sampling 
41 0.747 0.071 0.095 0.747 0.070 0.094 : ie + ORE. ; 
42 0801 0.093 0.116 0.800 0.092 0,116 variance known as 6; = 8; , using a flat prior m(o,) «1 for 
430.682 0.094 0.139 0.682 0.094 0.138 o., the posterior of o- will be proper provided that 
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m>p+2, where m is the number of small areas and p is 
the size of regression parameters 8 (Rao 2003, page 238). 
Since the number of small areas is usually relatively large, 
this condition is generally satisfied in practice. 

For the sensitivity analysis of vague proper priors, we 
can test the sensitivity of the posterior estimates to the 
choice of prior parameters a,,b,(0<i<m). Under Model 
1, we set a, =b, at four different values, i.e., 0.0001, 0.001, 
0.01 and 0.1. Table 5 presents the estimated posterior means 
for the corn and soybean data, and Table 6 presents the 
corresponding CVs. 


Table 5 
Comparison of Posterior Mean Estimates for Crop Data 
IG (a,, b,), a; = 6; 
County 0.0001 0.001 0.01 0.1 
Corn 
Franklin 142.862 142.593 143.155 144.311 
Pocahontas 91.560 91.912 91.422 91.974 
Winnebago 113.130 113.068 121.578 114.430 
Wright 1232547 eel Ole aL Soe ol 
Webster 97.856 98.231 99.132 98.511 
Hancock 123.478 123.858 124.395 124.138 
Kossuth LAO TOS 281 lS Silom ealulors 28 
Hardin (BSI MRIS. IB si OO 
Soybean 
Franklin 88.186 89.368 89.145 89.513 
Pocahontas 109.052 109.571 107.745 108.176 
Winnebago 88.053 87.478 86.267 87.302 
Wright 1O5:825™ 106712 0581429 104.676 
Webster 109455 BelOS:392 SeelOO 835 an lO? 
Hancock 102.876 103.413 102.240 101.808 
Kossuth 101.862 101.159 101.379 100.808 
Hardin 93.397 94.713 93.576 94.767 
Table 6 
Comparison of Posterior CVs for Crop Data 
IG (a;,, b;), a; = 6; 
County 0.0001 0.001 0.01 0.1 
Corn 
Franklin 0.129 0.124 0.128 0.125 
Pocahontas 0.356 0.351 0.347 0.341 
Winnebago 0.311 0.314 0.321 0.324 
Wright 0.250 0.246 0.235 0.236 
Webster 0.307 0.292 0.285 0.280 
Hancock 0.145 0.148 0.148 0.142 
Kossuth 0.109 0.110 0.107 0.104 
Hardin 0.176 0.173 0.178 0.168 
Soybean 

Franklin 0.239 0.233 0.231 O27, 
Pocahontas 0.276 0.281 0.271 0.296 
Winnebago 0.214 0.193 0.196 0.198 
Wright 0.232 0.223 0.231 0.226 
Webster 0.236 0.231 0.237 0.228 
Hancock 0.169 0.165 0.168 0.161 
Kossuth 0.148 0.145 0.142 0.135 
Hardin 0.217 0.215 0.213 0.213 


It is clear from Table 5 and Table 6 that the posterior 
estimates and the corresponding CVs are about the same 
and stable, which indicates that the HB estimates are not 
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sensitive to the choice of vague proper priors. For the milk 
data, the HB estimates are very stable to these proper vague 
priors (results are not provided here). Since the milk data 
has large sample sizes, flat priors on variance components 
can also be used to analyze the milk data under Model 1. 
We thus obtained the HB estimates based on the flat priors 
and compared them with the HB estimates based on the 
vague IG priors. These HB estimates are almost identical 
and stable with relative difference ranging from 0.07% to 
2.23%, an average value of 0.69% over 43 areas, which 
indicates that the posterior estimates of small area means 
based on Model 1 are very stable and not sensitive to the 
choice of flat priors or vague IG priors, provided that the 
sample sizes and number of small areas are relatively large. 


4. Conclusion and Future Work 


In this paper we have studied the well-known Fay- 
Herriot model with the situations where o7, the sampling 
error variances, are assumed unknown and where they are 
estimated by unbiased estimators s*, using the HB 
approach. The full HB approach with the Gibbs sampling 
method automatically takes into account the extra 
uncertainty associated with the estimation of o;. We 
applied the HB approach in two survey data analysis. Our 
results have shown that the proposed HB approach under 
Model 1 works quite well no matter the area-specific sample 
sizes are small or large. For future work, the proposed HB 
modeling approach can be extended to the general area level 
models studied by You and Rao (2002). Application of the 
new HB modeling approach includes the census 
undercoverage estimation as in You, Rao and Dick (2004). 
Under Model 1, the HB estimators of the sampling 
variances o; can be obtained. These HB estimators of «7 
can be used as alternative smoothed estimators for o? in the 
sampling models. Application and evaluation of the HB 
estimators of the sampling variances include the census 
undercoverage estimation and the Canadian Labour Force 
Survey (LFS) unemployment rate estimation (You, Rao and 
Gambino 2003). We also plan to compare the HB approach 
with the EBLUP approach as studied by Rivest and Vandal 
(2002) and Wang and Fuller (2003). 
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A Cost-Effective Strategy for Provincial Unemployment Estimation: 
A Small Area Approach 


Ali-Reza Khoshgooyanfard and Mohammad Taheri Monazzah ' 


Abstract 


This paper primarily aims at proposing a cost-effective strategy to estimate the intercensal unemployment rate at the 
provincial level in Iran. Taking advantage of the small area estimation (SAE) methods, this strategy is based on a single 
sampling at the national level. Three methods of synthetic, composite, and empirical Bayes estimators are used to find the 
indirect estimates of interest for the year 1996. Findings not only confirm the adequacy of the suggested strategy, but they 
also indicate that the composite and empirical Bayes estimators perform well and similarly. 


Key Words: Composite estimator; Design-based estimator; Empirical Bayes estimator; Indirect estimator; Non- 


sampling error; Synthetic estimator; Post-strata. 


1. Introduction 


Each year, sample surveys are conducted 1n Iran to obtain 
statistical information required for decision and_ policy 
making. However, these surveys cannot fulfill all statistical 
requirements because of two factors. The first one is related 
to the governmental and non-governmental sectors’ demand 
for comprehensive statistical information not only at 
national and regional but also at small area levels. Further, 
they need the information at shorter periods of time per 
year, say monthly or quarterly. The second factor is that the 
main source of statistical data in Iran is surveys, and there 
are financial limitations for conducting surveys several 
times per year at small area levels. These two factors chal- 
lenge statistical agencies to find efficient strategies to 
balance both cost and statistical information quality. The 
work presented here is an endeavor to overcome this 
challenge by using small area estimation (SAE) methods. 

The purpose of SAE methods is to provide acceptable 
estimates for some subpopulations in a sample design 
planned for the “whole” population regardless of the sub- 
populations. For example, a sample design is planned for 
estimating population parameters for the “country” and after 
data collection the parameters are estimated by the national 
sample data. If simultaneously “provincial estimates” of the 
parameters are needed, it is not possible to conduct separate 
provincial sample surveys. The provinces are unplanned 
subpopulations in the sense that the available sample design 
has been planned just for estimating the parameters for the 
country without considering the provincial level. In the 
nationwide sample, few or no sample units may be available 
for some provinces. Hence, acceptable estimates for such 
provinces (subpopulations) cannot be produced. 


Before the availability of SAE methods, such sub- 
population estimates were obtained by direct design-based 
estimation. If there were data from a given subpopulation in 
the nationwide sample, an estimate would be directly cal- 
culated according to the nationwide sample design by using 
“the available data”. The direct estimate may differ sub- 
stantially from the actual subpopulation parameter due to 
large sampling errors owing to small sample size. 

Statisticians and demographers have developed ways of 
estimating for such subpopulations. Indirect estimators have 
been suggested and applications have been increasing over 
the last twenty years. However, the SAE methods are still an 
active topic of study. See Purcell and Kish (1979, 1980), 
Ghosh and Rao (1994), Schaible (1995), Marker (1999), 
Pfeffermann (2002) and especially Rao (2003a) for problem 
definition and a review of the SAE methods. 

For a number of years, the Statistical Center of Iran (SCI) 
implemented annually a national one-stage cluster sample in 
order to estimate the intercensal unemployment rate at the 
country level. For sixteen years, separate one-stage cluster 
samples for all provinces have been conducted to estimate 
provincial unemployment rates. A weighted combination of 
provincial estimates then yields the unemployment rate for 
the total country. The increasing need for estimation of the 
unemployment rate at a provincial level on a monthly, or at 
least seasonal basis, and the lack of administrative records in 
Iran at both small and national levels persuaded SCI to try 
the SAE methods as the core of a revised strategy to meet 
the provincial need. 

The revised strategy consists of designing a sample 
survey only at the national level and producing the provin- 
cial estimates by SAE methods. A province in the strategy is 
a small area. This strategy demands a smaller sample size 
than that for aggregating provincial samples. If the revised 
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strategy proves practicable, time and cost of the data collec- 
tion can be reduced, and produce provincial estimates on a 
monthly basis. The smaller sample is easier to control in the 
field, and estimates are less affected by nonsampling errors. 
This paper is intended to answer the following questions: 


1. Can a nationwide sample substitute for separate 
provincial samples for making estimates of the 
provincial unemployment rates? 


2. From the three SAE methods — synthetic, com- 
posite and empirical Bayes estimators — which one 
produces the best estimates? 


To answer empirically these two questions, estimates were 
produced for the year 1996 when the actual values of the 
provincial unemployment rates are available from the 1996 
Census. Consequently, the actual bias of each provincial 
estimate can be computed. 

The process includes the following three stages. First, a 
sample of size 13,000 from the whole country is selected 
(the 1996 Census data file). The sample size is determined 
at the national level, and is allocated to all provinces pro- 
portionally to population. The allocation provides sample 
from each province enabling direct estimates of the un- 
employment rate for each province. Direct estimates are not 
necessarily acceptable for all provinces because of the large 
sampling errors due to small sample sizes in some 
provinces. Second, applying three SAE methods, indirect 
estimates are produced for each province. Third, the indirect 
estimates are evaluated by comparing them with corre- 
sponding actual values, computing MSEs, mean of absolute 
errors (MAE), and mean of errors (ME). 

In addition to this introduction, the paper takes in three 
more sections. Section 2 offers a short review of the three 
estimators used in this paper, including the estimation 
methods, their corresponding MSEs, and properties of the 
estimators. The estimates and corresponding computational 
aspects are presented in section 3, where performances of 
the estimators are tentatively appraised. Section 4 is devoted 
to final remarks and recommendations about the estimators 
and the merit of the SAE strategy. 


2. A Glance Over the Estimators 


Indirect estimators used in the study are introduced 
briefly. However, an excellent discussion of the SAE 
methodology is in Rao (2003a). First, the synthetic esti- 
mator is considered, and then the composite estimator. The 
empirical Bayes (EB) estimator as a model-based estimator 
is also considered. 
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2.1 Synthetic Estimator 


There is a family of small area estimators characterized 
as synthetic, see Rao (2003a, chapter 4). The traditional and 
simplest is discussed here. For this estimator, 


1. The country is partitioned into six post-strata on the 
basis of six age groups, see Table (1). 

2. Next, the number of unemployed persons is esti- 
mated in each province, providing the numerator in 
expression (1). 

3. The synthetic estimate of the i province is obtained 
by dividing the estimated number of unemployed 
persons in province i by its Economically Active 
Population (EAP), namely 


Re -{3 vB Is (1) 


where a is a direct design-based estimate of the un- 
employment rate in post-stratum j, N, is the EAP in 
province i, and N, is the EAP in the intersection of 
province 7 and post-stratum j, cell (i, 7) The synthetic 
estimate of the i" province is according to the official 
definition of the unemployment rate in Iran. 

The synthetic estimate shares all national sample data by 
using national direct estimates of the unemployment rate 
from the post-strata. It uses the six estimated “post-strata” 
unemployment rates computed over all provinces rather 
than specific estimates of the six “cells”. This process thus 
borrows strength because each province contributes to the 
national sample by pooling provincial sample units to 
overcome small sample sizes in each province. 

This estimator has three limitations: 


1. The smaller the inter-post-stratum variation is, the 
better synthetic estimator performs. It means that all 
provinces should have a rather equal unemployment 
rate in each age group. Using the national post-strata 
direct estimates equally for all provinces is allowable 
only under this assumption. If the homogeneity 
assumption is not satisfied, the synthetic estimator 
cannot reflect specific small area variation, and the 
estimates could be severely biased. 


2. If there are several variables that are important in post- 
stratification, the synthetic estimator cannot often use 
all of them because post-strata (after cross-classifi- 
cation of the several variables) have sample sizes that 
are too small and yield unacceptable direct estimates of 
the post-strata. Generally speaking, many post-strata 
give rise to poor direct estimates for some of the post- 
strata. This can create serious problems for synthetic 
estimation when a poor direct estimate receives a large 
EAP for a cell. 
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3. Quality of the EAPs can affect the synthetic estimates. 
Owing to lack of timely data sources such as admi- 
nistrative records, out of date EAPs from the 1986 
Census data are used here in order to produce the 
synthetic estimates for the year 1996. 


2.2 Composite Estimator 


The composite estimator of the i" province combines the 
synthetic and direct estimators of that province, namely 


ai et Oe (2) 


where P” is the direct design-based estimator for the i" 
province, and 0 < W, <1. Expression (2) improves upon (1) 
by exploiting both estimators. That is, provincial differences 
may take into account in the composite estimator via the 
provincial unbiased direct estimates and instability of the 
direct estimator may be reduced via the synthetic estimator. 
The weight W, can be specified so as to minimize mean 
square error of P°,MSE(P°). Assuming Cov(P”, 
P*) = 0, the weight is simplified as 
opt 
VANS marcha ate FUER T (3) 
(V(P°)/MSE(P*)) +1 


where V(P”) and MSE(P*) are the variance of 2” and 
the mean square error of Ps respectively. In expression 
(3), the weights of the direct and synthetic estimators in (2) 
are proportional to the MSEs of the two estimators. See 
Schaible (1978) and Rao (2003a, page 58) for properties of 
the estimator and weight. 

In practice, we should estimate MSE(P?) and V(P? ) 
to generate an estimate of the weight (3). If there are some 
sample data from the i province, according to the sample 
design, an unbiased design-based estimator of V(P? ) can 
be computed by using only the sample data. Therefore, only 
an estimator for MSE(P’) is required. Under the assump- 
tion that Cov(P? ; P*) ~0, Ghosh and Rao (1994) pro- 
posed the unbiased estimator 


MSE (AY) (Piha an (2?) (4) 
Under the same assumption, one can easily show that 
MSE(P°) =W V(B?)+(1-W,) MSE(P*). GS) 


The estimator (4) may result in negative estimates for 
some provinces, and the weight in expression (3) is no 
longer computable. In this case, instead of (3) and (4), we 
have used respectively the combined weight in (6) and 
AMSE = (1//') D1, MSE(P*) where J’ is the number of 
small areas having positive estimated MSE (see Gonzalez 
and Waksberg (1973) for more details): 
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y ths Mon) R= w= (6) 


[> V(P”) /IMsEe) +1 


In addition to expressions (3) and (6), Copas (1972), Ghosh 
and Rao (1994), and Thompsen and Holmoy (1998) suggest 
alternative weights. 


2.3. Empirical Bayes (EB) Estimator 


Model based SAE methods have received more attention 
than the synthetic and composite esitmators. Marker (1999) 
regarded the SAE methods as having a common element 
expressed through regression models. The EB method is of 
the regression type. Consider the following mixed model 
(see Rao (2003a, page 76)): 


g=XPt+vo+E (7) 
where 
pe p? 
Spl eet ee i) 
IP iP 


X isan /xk design matrix of supplementary variables, B 
isa kx1 vector of unknown parameters, and v and € are 
Ix1 random vectors (I is the number of provinces). 
Assume that: 


1. v and € are independent. 
2) A (s)=0,and-Var(s) = Diag(d, sd: 
3. v~N(0, dX) where > =Diag(t’, ..., t’). 
Ghosh and Meeden (1997) show that the EB estimate of the 


i element of g is: 


o'® =Wx'B+(1-W,)g, (8) 


where x’ and g,are the i” row and the i” component of 


X and g respectively, and W, is an estimate of 


ad 
py TaD a (9) 
Cott 
Consequently, the EB estimate of the i" rate is: 
: exp(W,x' B+ (1-W,)g. 
BEE pW,x; B+ (—W,)g;) (10) 


p 1+exp(W,x' B+ (1-W,)g,) 


It is obvious that (10) needs two estimates for B and the 
weight in (9). On the other hand, the weight in (9) relies on 
the estimates of f° and d’. By applying the delta method, 
(g; ia V (Pp? ) generates an estimate of d: where g, 
through the first derivative of g, = Ln(P? /1- pe ). Based 
on Chand and Alexander (1995), estimates of B and t” are 
found by simultaneously solving 
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— — yl oa = 
ea XBYV(g-XB)IT-K) ay 


B A (XN), OC ies 


where V =Diag(d, +?°,...,d7+t°). Note that the 
equations in (11) are solved by numerical iteration with an 
initial value for 77. 

The EB and composite estimators have similarities 
although they arise from different approaches. Both esti- 
mators have two components; a direct component GPa in 
(2) and g, in (8)) computed from the provincial sample 
data, and an indirect component ee in (2) and x’ 8 in(8)) 
constructed from the national sample data and supple- 
mentary information. Both estimators (2) and (8) give more 
weight to the indirect component when it is reliable. Other- 
wise the direct component receives more weight. Additional 
details are given in Cressie (1989), Ghosh ef al. (1998) and 
Rao (2003 a, b). 


3. Estimation for Iran 


Estimates were produced for the year 1996 because the 
1996 actual unemployment rate of each province is known 
from the 1996 Census. As a result, the actual bias of each 
estimate can be computed. 

In 1996 the country consisted of 26 provinces. However, 
21 provinces are studied here because supplementary 
information from the 1986 Census was available for 21 
geographically unchanged provinces between the years 
1986 and 1996. To make the three indirect estimates, at the 
national level, a sample was planned and its sample size was 
determined for estimating the unemployment rate of the 
country as a whole. Each province is a small area. The 
national sample was allocated among the 26 provinces 
proportional to population in order to have sample data from 
each province (a top-down approach). This enabled direct 
design-based estimates for each province and its corres- 
ponding variance required for both the EB and composite 
estimators. The sample design is able to produce good 
estimates for the country and for some provinces. 


3.1 Computational Aspects 


To construct synthetic estimates, six age groups formed 
the post-strata. The estimated unemployment rate of each 
group based on the national sample and its corresponding 
actual value based on the 1996 Census are presented in 
Table (1), which also contains absolute errors of the esti- 
mates. 

The estimates for the first two groups have very large 
error. Therefore, if a province in expression (1) gives large 
EAPs to these age groups, its synthetic estimate may not 
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perform well. The 1986 Census data were used in 
computing the EAPs for all provinces and cells (NV, and 
N,, in expression (1)) because, in the absence of adminis- 
trative records, the nearest census to the year 1996 is the 


main source of data at any level. 


Table 1 
Post-strata Characteristics 


Age Group Estimated Rate (P;) Actual Value Absolute Error 
10—15 0.3240 0.2826 0.0414 
16—20 0.2402 0.2629 0.0227 
D\\ 5 0.1868 0.1856 0.0012 
26—30 0.0811 0.0802 0.0009 
3150 0.0363 0.0366 0.0003 

More than 50 0.0653 0.0648 0.0005 


To construct the composite estimates, provinces were 
divided into two groups. The first consists of 14 provinces 
that used the weight in expression (3), and the second of 
seven provinces used the common weight W° = 0.873184 
based on (6). Because the estimator in expression (4) 
produces negative estimates for MSE(P?) for these seven 
provinces, the AMSE was used. 

To construct the EB estimates, d? was estimated by 
using the delta method and then 7” was estimated following 
Prasad and Rao (1990) by using a SAS/IML program (the 
program is available from the authors). An initial estimate 
for ¢° is required in this program, and was calculated by the 
moment estimation method as ¢? = 0.3117194. To solve the 
equations in (11), the following 21x2 design matrix was 
used, whose first and second columns are 1s and EAPs, 
respectively: 


1 133,449 
1 141,124 
1 883,653 
X=!1 795,714 
P22 O 
L A162.892 


The estimated ¢? and B are 


e . ( —2.066874 
7? = 0.5596389, B= ‘ 
-1.273x 10 


To test normality, a normal Q—Q plot and a Shapiro- 
Wilk’s test for standardized residuals of the fitted model 
were examined. The points in the Q—Q plot are close to a 
straight line, and the test did not reject the null hypothesis of 
normality ( p-value = 0.851). 
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3.2 Results 


The results are organized into four parts. First, bias in the 
forms of error and absolute error is examined using two 
criteria, ME and MAE. Second, MSEs are compared among 
methods. Third, efficiencies of the indirect estimators rela- 
tive to the direct estimator are evaluated. Finally, the 
weights of the direct components in expressions (2) and (8) 
are analyzed. All the results are depicted in appropriate 
figures, however, details can be found in Table (2). 

Suppose S, is the allocated sample size from the national 
sample to a given province and S, the required sample size if 
the sample size is separately determined for the province. In 
other words, if there is a sample of size S, from the province, 
an acceptable direct estimate can be then computed for the 
province. Therefore, (S,/S, ) x 100 measures how much the 
available sample size (S,) is adequate for a given province. 
This measure is used on horizontal axes of all plots as a 
basis for comparison sample size effects. 

The synthetic estimator has the highest MAE, which was 
even larger than that of the direct estimator (see Figure 1). 
Conversely, MAEs of the composite and EB estimators are 
the lowest, and very similar to one another. Based on ME, 
there is a slight overestimation of the actual value for all 
estimators. The direct estimator has the lowest ME because 
it is unbiased. MEs of the composite and EB estimators are 
close and the synthetic estimator has the highest ME. 

For the direct, composite, and EB estimators, all 
provinces with S,/S, => 10% have absolute errors less than 
0.02. The highest absolute errors belong to Ilam and 
Kohgiluyeh & Boyerahmad which have the smallest 
populations and very small S,/S,. Plots of these three 
estimators have relatively similar patterns. The story is 
different for the synthetic estimator because the “national” 
sample data are only used in making synthetic estimates 
through the post-strata direct estimates and then the 
“national” sample size (not S,/S,) affects the synthetic 
estimate of a province through the cell EAPs. In other 
words, if a post-stratum does not have “enough” national 


sample data to yield acceptable direct estimates, and a 
province gives large EAP to the post-stratum direct 
estimate, the province has a poor synthetic estimate. This is 
the case for Sistan & Baluchestan, Bushehr, Tehran and 
Lorestan because of poor direct estimates for the first two 
post-strata (the age groups of 10-15 and 16-20) and large 
young populations of these provinces. 

The lowest MSE always belongs to the composite or EB 
estimator (see Figure 2). However, MSE of the composite 
estimator is often lower than that of the EB estimator. The 
MSE of the synthetic estimator is always higher than those 
of the other estimators, even the direct estimator. 

As the S,/S, increases, the MSE decreases for the direct, 
composite and EB estimators (see the descending trend in 
Figure 2). This effect is very drastic for Tehran (S,/S,= 
36%). Again, there are two exceptions for the three 
estimators, Ilam and Kohgiluyeh & Boyerahmad, both 
having the smallest populations and very small S,/S,. The 
pattern of Figure 2 for the synthetic estimator may be 
misleading because seven provinces used AMSE. However, 
the four previous provinces (Sistan & Baluchestan, Bushehr, 
Tehran and Lorestan) also do not conform to the pattern. As 
a general rule for an estimator, the greater the dependency 
on the provincial direct estimates the stronger the relation- 
ship between the MSE and the ratio S,/S,. 

The relative efficiencies (RE) of the three indirect esti- 
mators compared to the direct estimator for all provinces are 
often smaller than or equal to one for the composite and EB 
estimators and greater than one for the synthetic estimator. 
Some composite estimates have good REs: Semnan (0.34), 
West Azarbayejan (0.46), Khorasan (0.70), Kermanshah 
(0.75) and Hamadan (0.77). Means of REs (RE Ee PSs 
RE =0.8595 and RE =0.9951) indicate that the 
composite estimator is the most efficient estimator among 
the three indirect estimators. Further, in Figure 3 as S,/S, 
increases RE™® approaches one. Figure 3 as well as Figure 2 
may be misleading for the synthetic estimator. 
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Table 2 
Provincial and Estimator Characteristics 

Province EAP S, S,  S,/S, RES RE®® RES AES AE‘® AES AE? MSE MSE"® MSE MSE? 
Bushehr 133,449 146 4,550 3.2% 0.96 1.17 25.57 0.03300 0.01687 0.06501 0.02644 ~—-0.0003030 0.000368 +~—0.0080483 0.003148 
Chaharmahal & Bakhtiyari* 141,124 203 4,063 5% 0.87 0.95 6.52 0.02136 0.02135 0.03644 0.02031 0.0003813 0.000417 —_:0.0028670 ~—_:0.0004397 
Esfahan 883,653 1032 5,850 17.6% 0.90 1.00 9.56 0.01268 0.01421 0.00990 0.01504 ~—0.0000533 + —-0.000059 ~—-0.0005631 —_-0.0000589 
Fars 795,714. 925 6175 15% 0.91 0.99 9.69 0.00610 0.00886 0.02235 0.00904 —0.0000836 0.000091 +~—:0.0008931 —_-0.0000922 
Gilan* 734,196 683 5,364 12.7% 1.04 0.97 17.25 0.00484 0.00460 0.01107 0.00393 —0.0001728 ~—-:0.000162 ~—:0.0028670-—:0.0001662 
Hamadan 387,517 439 4,550 9.6% 0.77 1.00 3.36 0.01294 0.01701 0.00675 —-0.01880 + 0.0001155 0.000150 —_0,0005030 00001498 
Hormozgan* 168,268 198 4,063 4.9% 0.84 0.93 5.12 0.01984 0.01734 0.02821 0.01862 ~—-0.0004731 ~—-0.000519 —_-0.0028670 00005600 
lam 84,210 111 4,063 2.7% 0.83 0.87 4.94 0.04901 0.05201 0.03395 0.06579 -~—-:0.0013919 +~—-0.001450 ~—-0.0082747 0.016734 
Kerman* 312,768 450 5,200 8.7% 0.96 0.97 12.00 0.03615 0.03672 0.02864 0.03724 0.0002283 0.000231 +—-0.0028670 —_-0.0002389 
Kermanshah 357,096 436 3,575 12.2% 0.75 0.96 3.07 0.00265 0.00928 0.02641 0.01210 0.0002747 0.000349 ~—-0.0011190 —_0.0003640 
Khorasan 1,410,863 1,587 8125 19.5% 0.70 0.99 2.36 0.00515 0.00193 0.01353 0.00160 ~—-0.0000298 0.000042 ~—-0.0000999 +—_0.0000424 
Khuzestan* 609,044 786 4,225 18.6% 1.03 0.97 16.83 0.01034 0.01247 0.00308 0.01140 —0.0001760 0.000166 00028670 00001704 
Kohgiluyeh & Boyerahmad 90,655 105 3,575 2.9% 0.83 0.86 4.83 0.05486 0.05932 —_-0.02630-—-0.07165 -—-0,0013629 + 0.001408 0.079493 -0.0016449 
Kordestan* 276,575 341 5,200 6.6% 0.91 0.95 9.22 0.03105 0.02814 0.03641 0.03027: 0.0002833 0.000297 ~—-0.0028670 0.000311 
Lorestan 310,918 341 3,575 9.5% 0.86 0.95 6.22 0.00943 0.01383 0.04101 0.01754 0.0004090 0.000451 —-0.0029534 0.004747 
Mazandaran* 917,259 1,043 6,013 17.3% 1.30 0.98 33.57 0.00199 0.00188 0.00310 0.00183 0.0001112 0.000084 —0.0028670 —0.0000854 
Semnan 110,166 121 4,713 2.6% 0.34 1.08 0.51 0.02776 0.01929 0.03661 0.01042 00001534 0.000491 ~—-0.0002317 -—-:0.0004542 
Sistan & Baluchestan 272,752 318 4,875 6.5% 0.96 0.97 26.53 0.00431 0.00228 0.08606 ~—-0.00123-—-0.0002519 0.000254 —_-0.0069347 _—_-0.0002614 
Tehran 2,343,290 2,913 8,125 35.9% 0.99 1.00 83.08 0.00605 0.00573 0.04767 0.00555 —-0.0000209 ~—-0.000021 +~—-0.0017530 0.000211 
West Azarbayejan 522,976 654 6,500 10.1% 0.46 0.98 0.85 0.00505 0.01247 0.00182 0.01309 + 0.0000552 0.000118 0.001024 —0.0001199 
Yazd 162,892 207 5,038 4.1% 0.82 1.36 4.52 0.01414 0.00968 _ 0.01008 0.01950 0.0001299 0.000215 _0.0007164 _0.0001586 


*Denote provinces for which expression (3) produces negative estimates for MSEs. 
EAP: Economically Active Population 


S,: Allocated Sample Size 
S;: Required Sample Size 
RE: Relative Efficiency 
AE: Absolute Error 


MSE: Mean Squared Error (the lowest MSE is bold for each province) 
C, EB, S and D stand for Composite, Empirical Bayes, Synthetic and Direct estimators, respectively. 
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Figure 1. Absolute errors of the estimates against S,,/S,. 
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Figure 2. MSEs of the estimates against S,/S,. 
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Figure 3. Relative efficiency (Estimated MSE of indirect estimator/Estimated variance of direct estimator) against S,/S, 
(the plot of synthetic estimator has a different scale on the vertical axis for legibility). 
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The direct component of the estimator in expression (8), 
g,, always receives more weight than the indirect 
component. This is the case for the composite estimator, 
except for two provinces of Semnan and West Azarbayeyjan. 
For the composite estimator, Rao (2003a, page 58) states 
that “the optimal weight W,°"' will be close to zero or one 
when one of the component estimators has a much larger 
MSE than the other, that is, when f, = MSE(P‘)/ 
MSE(P°) is either large or small. In this case, the estimator 
with larger MSE adds little information and therefore it is 
better to use the component with smaller MSE.” This 
comment is clearly illustrated for Bushehr (W = 0.962355, 
RE® = 25.27), Sistan & Baluchestan (W =0.963670, 
RE°= 26.53) and Tehran (W = 0.988083, RE* = 83.08), 
because the direct estimates of these provinces have smaller 
MSEs than the synthetic estimates. Figure 4 clearly shows 
an ascendant relationship between the weight and S,/S, for 
the EB estimator. For the composite estimator, the lowest 
and highest weights pertain to the provinces with the lowest 
S./S, and the highest S,/S, respectively. 

In general, the synthetic estimator performs poorly based 
on the MAE, ME, MSE and RE criteria, even though the 
synthetic estimates of some provinces are individually 
closer to actual values than other estimates. However, the 
synthetic estimates have been computed under the most 
disadvantageous conditions. The EAPs applied to construct 
the synthetic estimates are based on the 1986 Census (ten 
years before the year when the estimates were produced). In 
addition, the direct estimates of the first two post-strata are 
quite different from the other post-strata, causing poor 
synthetic estimates. 

To address the first problem, administrative records 
should be developed; for the second, post-strata estimation 
should be handled in the sample design in advance. If not 
only post-strata estimation but also provincial classifications 


W (Composite) 


Sal Sr 


in planning the sample design are considered in advance, 
good direct estimates for the post-strata can be expected. 
Consequently, good synthetic estimates for the provinces 
can be expected. The provincial classifications can increase 
homogeneity by putting similar provinces in classes togeth- 
er and using only sample data of the classified provinces to 
make the direct post-strata estimates to construct the syn- 
thetic estimates of those provinces. 

The composite and EB estimators usually perform well 
when S,/S, is 10% or larger for a province because the 
direct components of the estimators (2) and (8) are relatively 
stable and receive a larger weight, especially for the EB 
estimator. Tehran, Khorasan, Khuzestan and Esfahan are of 
this type, while Bushehr, [lam, Kohgiluyeh & Boyerahmad 
and Semnan are not. 


4. Final Remarks 


In developing countries like Iran, administrative records 
are not often available both at small and large area levels. 
Surveys may yield satisfactory estimates for large areas but 
not for small areas. Periodic censuses do not meet all 
demands for effective policies and planning. These limi- 
tations lead to deficiencies in official statistics. Therefore, 
the statistical planning activities of SCI are directed towards 
compensating these deficiencies by using new methods and 
strategies. The present study proposes a cost-effective 
strategy to overcome some of the limitations. 

In this study, the findings support the idea that a nation- 
wide sample design can be used instead of the separate 
provincial sample designs by applying suitable SAE 
methods. The nationwide sample design consists of nearly 
13,000 persons, whereas the twenty-one separate provincial 
sample designs totally consist of almost 100,000 persons. 


0 10 20 30 40 
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Figure 4. The weights of the direct components of composite and EB estimates against S,/S,. 
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The provincial design is the method currently used to 
produce provincial estimates by SCI. Using the national 
sample design decreases costs more than 80 percent. In 
addition, note that: 


1. Although some SAE methods do not rely on existing 
sample data from all small areas, the strategy for 
producing provincial estimates is more appropriate 
when the small areas of interest are pre-specified. 
Therefore, the nationwide sample can be allocated to 
all small areas of interest to produce direct design- 
based estimates. It is important to adjust the sample 
design to accommodate the SAE methods before data 
collection begins. As Singh, Gambino and Mantel 
(1994, page 3) note 
“small area needs should be recognized at the 
early stages of planning for large scale 
surveys. The sample design should include 
special features that enable production of 
reliable small area data using design or model 
estimators”. 

Therefore, SCI must re-plan sample designs to reflect 

small area needs. 


2. The SAE estimators usually perform well as the 
sample size increases. To improve provincial esti- 
mates, the nationwide sample size can be enlarged to 
have larger sample sizes from each province. Also, 
the provinces can be classified into groups with 
similar characteristics, such as unemployment rates, 
socio-demographic variables, and so on. Separate 
sample size would then be determined for each group. 


3. Appropriate supplementary variables, which are 
related to the variable of interest, play a central role in 
improving the estimators. 


— The synthetic estimator used only one variable 
(age) for partitioning but it may be possible to use 
another variable or a combination of variables for 
partitioning. The post-strata in the synthetic 
estimator should be formed by variables that 
reduce variation in each post-stratum. These 
variables can indirectly affect the composite 
estimator as well. 


— The EB model can be improved with better 
supplementary information. Therefore it is 
important to try different supplementary variables 
to find the best model. In this work only EPA was 
used as the independent variable in the model, but 
there may be other variables that produce better 
estimates. 


4. The composite estimator performs relatively better 
than the synthetic and EB estimators. However, the 
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results are only meant to provide a first impression of 
the utility of SAE methods. More research is needed to 
develop a generic SAE methodology in Iran. Further, 
the SAE methods should be applied not only in 
estimating unemployment rates but also in estimating 
other parameters, and SAE methods should be 
compared with the estimates coming from separate 
sample designs. 
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Design Effects for Multiple Design Samples 


Siegfried Gabler, Sabine Hader and Peter Lynn | 


Abstract 


In some situations the sample design of a survey is rather complex, consisting of fundamentally different designs in different 
domains. The design effect for estimates based upon the total sample is a weighted sum of the domain-specific design 
effects. We derive these weights under an appropriate model and illustrate their use with data from the European Social 


Survey (ESS). 


Key Words: Stratification; Clustering; Variance component model; Intraclass correlation coefficient; Selection 


probabilities. 


1. Introduction 


In survey research complex sample designs are often 
applied. These designs have features such as stratification, 
clustering and/or unequal inclusion probabilities, that lead to 
“design effects”. The design effect is a measure that shows 
the effect of the design on the variance of an estimate. 
Design-based it is defined as follows (see Lohr 1999, page 
239): 
deff (plan, statistic) = 

V(estimate from sampling plan) 
eee from an srs with same i 


of observation units 


where srs indicates a simple random sample. The use of 
clustering and/or unequal inclusion probabilities typically 
leads to design effects greater than 1.0; in other words the 
variance of an estimate is increased compared to the 
variance of the estimate from a simple random sample with 
the same number of observations. The consideration of 
design effects 1s very important when deciding upon the 
sample size of a survey in advance. For example, if a 
comparative survey with different countries is planned it is 
very useful to have estimates of the design effects for the 
different countries. Then it is possible to choose the net 
sample sizes in a way that the precision of the estimates will 
be approximately equal. For this, for a certain degree of 
precision the sample size that would be needed under srs 
(effective sample size) has to be multiplied by the predicted 
design effect. 

The European Social Survey (ESS, see www.european 
socialsurvey.com) is a survey program where design effects 
are taken into consideration for calculating net sample sizes 
—aiming at the same effective sample size for each country 
(Ng = 1,500). 22 countries participated in the first round of 
the ESS, only three of them with unclustered, equal 


probability designs (srs): Denmark, Finland and Sweden. 
For all other countries there was the need to predict the 
design effect in advance of the study. For this, a model 
based approach (see Gabler, Hader and Lahiri 1999) can be 
used which distinguishes between a design effect due to 
unequal inclusion probabilities (term 1) and a design effect 
due to clustering (term 2): 


ee 
deff =m—>——. x [1+ (b' -l)p] = deff, x deff. (1) 


L 


>" m,w 
t—" 

where m, are respondents in the i” selection probability 
class, each receiving a weight of w,,p is the intracluster 
correlation coefficient and 


where 6. is the number of observations in cluster 
c(c=1,...,C) and w, is the design weight for sample 
element 7 in cluster c. (This is of course a simplification that 
assumes no association between y and w, or between w, 
and 5 and ignores any effects of stratification, that will 
tend to be beneficial and modest. See Lynn, Gabler, Hader 
and Laaksonen (2007, forthcoming) and Park and Lee 
(2004) for discussion of the sensitivity of deff predictions to 
these assumptions; see Lynn and Gabler (2005) for 
discussion of alternative ways to predict deff, ). 

In some countries the applied designs were even more 
complicated, consisting of fundamentally different designs 
in each of two independent domains. In the UK, e.g., the 
design was a mixture of a clustered design with unequal 
inclusion probabilities (in Great Britain) and an unclustered 
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sample (in Northern Ireland). In Poland, simple random 
samples were selected in one domain (cities and large 
towns), while a two-stage clustered design was applied in 
the second domain (all other areas). In Germany, a clustered 
equal-probability sample was selected in each domain (West 
Germany including West Berlin; East Germany), but the 
sampling fractions differed between the domains. 

The question arose how to predict design effects for these 
dual design samples. As we show below, it is not simply a 
convex combination of the design effects for the different 
domains—apart from in some special cases. A general 
solution for multiple design samples will be presented in 
section 2, with illustrations of the application of this solution 
to prediction of design effects prior to field work (section 3) 
and to estimation of design effects post-field work (section 
4). Section 5 concludes with discussion. 


2. Design Effects for Multiple Design Samples 


Let {C,,...,C,} be a partition of the clusters into K 
domains. Then Ch =D =p jo) eth a itis 
where m, = Ycec, b, is the number of observations in the 
k™ domain of clusters. Let y, be the observation for 
sample elementyjain-clustersc(e =1.4.,.Cs 97 = tk. 20s): 
The usual design-based estimator for the population mean is 


where 


= (ia) ceC, j=l 

Ww b. 
2 2% 
ceC, j=l 


We assume the following model M1: 


E(y,;) ie 


nea es fot) GH datieC ppm deemesa) 
Cg * 


(2) 
P.O if c=c'eC, ; j#j' a leaoks. 


Cov(y,; 5) Vari! ) ae 
ee 0 otherwise 


Model M1 is appropriate to account for the cluster effect 
with different kinds of clusters and generalises an earlier 
approach (see, e.g., Gabler et al. 1999). More general 
models can be found in Rao and Kleffe (1988, page 62). We 
define the (model) design effect as deff = Var,,,(¥,,)/ 
Vary>(v), where Var,,,(y,,) 1s the variance of y, under 
model M1 and Var,,,(V) 1s the variance of the overall 
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sample mean jy, defined as ¥¢, pas y,/m, computed 
under the following model M2: 
E(yg)=e 


won ; for. ¢= i Casa ae 
ar(y,)=9 


(3) 
Cov .Vey)=9 for all (¢, /)#(C',7’). 


Note that model M2 is appropriate under simple random 
sampling and provides the usual expression, Var,,,(¥) = 
o/m. 

Quite analogous to Gabler et al. (1999) we note that 


@ 2 
vann(& Ms Wy | = 
j=] 


c=1 j 


K b, b, 
2, 92 {3 Wwe + Pa wma (4) 


k=1 ceC, | j=l oi 
Thus 
b, : 
«2a 
deff ay, | am ee Aether) 
Hi} 32 aga 
c=l j=l 
where 
b, 
2 
deff, =m, aa > XH, — Dp.) = 4 xd» 
x y Mig 
ceC, j=l 
and 


It can be seen that deff'is not a convex combination of the 
specific {deff,} except in some special cases. We consider 
here four realistic scenarios, each representing a simplifi- 
cation of the general case. Only in two of these scenarios 
(scenarios | and 4) does the combination become convex: 


Scenario 1: Equal weights for all units 
If w,, =1 forall c, 7, then expression (5) simplifies to: 


deff = 3 = deff, (6) 


k=l 


Scenario 2: Equal weights within each domain 


If w,=w, for all ceC,,7, then expression (5) 
becomes: 
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mM,W, 


K 
deffi= eal alae nde ffx (7) 
ie Ne my, We mk 
k=l 
Scenario 3: Weighted sample size proportional to domain 
population size 
If 


where N, is population size in domain k;N = di, N,, 
then expression (5) becomes: 


deff = 3 (4) —— deff (8) 


Scenario 4: Unweighted sample size proportional to domain 
population size 
If 


then expression (8) becomes: 


deff = S3 = deff, (9) 
k=) 


3. Application to Prediction of Deff 


In round 1 of the ESS, the sample design was a 
combination of two different sample designs for 5 out of 22 
countries: United Kingdom, Poland, Belgium, Norway and 
Germany. We can apply the general formula (5) for design 
effects for multiple design samples to each of these cases, 
where K =2. In some cases, we can equivalently use one of 
the simplified expressions (6) to (9). Here we illustrate how 
the formulae would be used in the prediction of design 
effects prior to fieldwork, for the purpose of establishing the 
required net (respondent) sample size to achieve a 
prescribed precision of estimation. In each case, the 
approach is to predict {deff,} using (1) for each k and then 
use (5) to predict deff. To predict {deff,}, the observed 
values of {w,,} from the ESS round | respondent sample 
are used to estimate, b’,m, and w;. In other words, these 
could be thought of as predictions for a future survey using 
the same design (e.g., a future round of ESS). For 
illustration, we assume p,=0.02Vk with a clustered 
design and p, =0.00V 4 with an unclustered design (0.02 
is in fact the default value that was used for predicted design 
effects for clustered samples on the ESS in cases where 
estimates from previous surveys were not available). Our 
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focus here is on the application of (5). For a more detailed 
description of the sample designs see Hider, Gabler, 
Laaksonen and Lynn (2003). We use three of the ESS 
countries—Poland, UK and Germany~as illustrations as 
these designs differ between the domains in different ways. 
The designs of Norway and Belgium were similar to that of 
Poland, with equal probabilities for all units but one domain 
clustered and one unclustered. 


3.1 Poland 


In Poland, the first domain covered the population living 
in towns of 100,000 inhabitants or more. Within this 
domain, a srs of persons was selected from the population 
register (PESEL data base) in each region, with slight 
variation between regions in the sampling fraction, 
reflecting anticipated differences in response rate. There 
were 42 towns in this domain and they accounted for about 
31% of the target population. 

The second domain corresponded to the rest of the 
population— people living in towns of 99,999 inhabitants or 
fewer and people living in rural areas. This part of the 
sample was stratified and clustered (158 clusters). The 
sampling of this second part was based on a two-stage 
design: PSUs were selected with probability proportional to 
size. The definition of a PSU was different for urban vs. 
rural areas. For urban areas, a PSU was equivalent to a 
town, whereas for rural areas, it was equivalent to a village. 
In the second stage, a cluster of 12 respondents was selected 
in each PSU by srs. 

In the first domain, p,=0 and deff., =1. The modest 
variation in selection probabilities leads to deff,,, = 1.005 
and, therefore, deff, = deff, -deff,, =1.005. In the second 
domain, the design effect due to clustering is anticipated to 
be deff., =1.18 (based on a prediction of b =10.07) and 
deff, =1.01 which results in deff, = deff., deff, = 
1.19. Substituting these values of deff, in (5) leads to a 
prediction of deff =1.17. 

The design for Poland differs only slightly from scenario 
2 and it can be seen that in this case the simpler expression, 
(7), provides a reasonable prediction if we approximate the 
weights as follows. Domain | contains 37.3% of the gross 
sample and 31% of the target population. Thus 


_N,/N _ 0.310 


w, oD | 
nde 0.373 
and 
ha GD 
| WE 0i627 


respectively, where n, is selected sample size in domain 
Ses 
k; eat Ny. 
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Now, we can apply expression (7) to find the predicted 
design effect for estimates for Poland: deff= 
(0.194-1.005) + (0.821-1.19) =1.17. 


3.2. United Kingdom 


In the UK, the ESS sample design differed between 
Great Britain (England, Wales, Scotland) and Northern 
Ireland. In Great Britain a stratified three-stage design with 
unequal probabilities was applied. At the first stage 162 
small areas known as “postcode sectors” were selected 
systematically with probability proportional to the number 
of addresses in the sector, after implicit stratification by 
region and population density. At stage 2, 24 addresses were 
selected in each sector, leading to an equal-probability 
sample of addresses. At the third stage, one person aged 15+ 
was selected at the selected address using a Kish grid. 

For Northern Ireland a simple random sample of 125 
addresses was drawn from the Valuation and Land 
Agency’s list of domestic properties. One person aged 15+ 
was selected at the selected address using a Kish grid. Thus, 
the UK sample is clustered in one domain but not in the 
other. In both domains, there are unequal selection proba- 
bilities. 

In Great Britain we predicted deff., =1.20 (based on a 
prediction of b =11.11) and deff, =1.22, so deff, = 
1.46. In Northern Ireland we have predictions of deff., =1 
(by definition) and deff,, =1.27, so deff, =1.27. From 
expression (5), deff =0.978-1.46+ 0.023-1.27 =1.460. 
It should also be noted that the selected sample sizes in the 
two domains were chosen to result in net sample sizes that 
would be approximately in proportion to the population 
sizes. In other words, the simplification of scenario 4 
approximately holds. If we use expression (9), we get 
deff = N,/N deff, + N,/N deff, =0.97-1.46 + 0.03- 
1.27=1.457, demonstrating that this provides a reasonable 
approximation to (5) in this case. 


3.3. Germany 


In Germany independent samples were selected in two 
domains, West Germany incl. West Berlin, and East 
Germany incl. East Berlin. In both domains, the sample was 
clustered and equal-probability, but a higher sampling 
fraction was used in East Germany. 

At the first stage 100 communities (clusters) for West 
Germany, and 50 for East Germany were selected with 
probability proportional to the population size of the 
community (aged 15 years or older). The number of com- 
munities selected from each stratum was determined by a 
controlled rounding procedure. The number of sample 
points was 108 in the West, and 55 in the East (some larger 
communities have more than one sample point). At the 
second stage in each sample point there was drawn an equal 
number of individuals by a systematic random selection 
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process. This was done using the local registers of residents’ 
registration offices. 

Since the sampling design is self-weighting for both East 
and West Germany, but with disproportional allocation, 
scenario 2 applies and we can use expression (7), where 


“f = Neast 
Wy = WrasTt = 


LT ea 
N  Ngast 


and 


oii stage ia le ws pig 
N  Avesr 

(we note that common practice on some surveys is to 
scale the weights so that they sum to population sizes. This 
would make no difference to the application here as 
expression (5) involves only ratios of sums of weights). 

The design effect due to clustering for each domain was 
predicted as deff, =1.39 and deff, =1.35, respectively 
(via predictions of b° = 20.56 and 18.65 respectively), so 
from (7) we have 


deff =0.120-1.39 2 0991-135 =13E 


It should be noted that in this case any convex 
combination of the domain-specific design effects will lead 
to a prediction of deff between 1.35 and 1.39. For example, 
(6) would give deff =1.36. This fails to take into account 
the differences in selection probabilities between the 
domains. With this particular design—where the only 
difference in design between domains is the difference in 
selection probabilities — deff might alternatively be predicted 
by taking the convex combination and multiplying it by the 
prediction of deff, from the first term in expression (1), viz. 
deff =1.36-1.09 =1.49. But this method is equivalent only 
in the special case where {deff,} are equal—and approxi- 
mately equivalent in this case, where the variation is small. 


4. Application to Estimation of Deff 


Here we illustrate the use of expression (5) in the 
estimation of design effects post-fieldwork. We present 
estimates for 5 demographic/behavioural variables and a set 
of 24 attitude measures from round | of the European Social 
Survey, for the same three countries as in section 3. For 
comparison, we present also the estimates that would be 
obtained using the simpler expressions (6), (8) and (9). It 
can be seen that the estimates of deff differ greatly between 
variables. This is to be expected, reflecting variation in the 
association of y with clusters and with selection probabi- 
lities. But here we are more interested in differences 
between estimation methods for the same variable. 
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For Germany, we see that estimators (6) and (9), which 
ignore variation in weights and in sampling rates between 
the two domains respectively, under-estimates deff for all 
variables. Estimator (8), which assumes only equal response 
rates in each domain, produces estimates very similar to (5). 
For Poland, all three simplified estimators under-estimate 
deff, though (6) perhaps performs marginally better than the 
other two. For UK, we observe the remarkable result that all 
four estimators produce almost identical estimates for every 
variable. The assumption in (9) (and therefore also that in 
(8)) holds for UK and while weights are by no means equal, 
the distribution of weights is very similar in each domain. It 
can be noted that (6) holds under a weaker assumption that 


ceC, j=l - mM, 

Cue Aik 
Ds We 

c=l j=l 
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i.e., that the share of the weights in each stratum equals the 
share of sample units. It is striking that these relationships 
between the estimators are consistent across all the variables 
considered. 


5. Discussion and Conclusion 


Expression (5) provides an appropriate means of 
combining design effects for domains with fundamentally 
different designs. It can be applied in estimation by 
estimating deffs in the usual way for each domain and then 
combining them using knowledge of the weight and domain 
membership of sample units. Use of (5) in the prediction of 
deffs before a survey is carried out is only slightly more 
demanding, requiring prediction of the share of the weights 
in the responding sample in each domain in addition to a 
method of predicting design-specific de/s. 


Table 1 
Estimates of Deff for Means Under 4 Estimators for 3 Countries 


DE 
Estimator: (alt (OC) 
Demographic/behavioural 
Persons in household L387. 1.85, 1.87 
Years of education 6ST ee | LMR ee 
Net household income 2.46 2.15 2.46 
Time watching TV 2.08@L.864.2.08 
Time reading newspaper LTS eA .624 2h 79 
Attitude measures 
Discriminated by race Tel Ose 03 1.16 
Discriminated by religion j PDN) ee 62 
General happiness 7) ae Bes) 
Trust in others 20a 968 2220 
Trust in Euro Parliament WSScer i SOR HES3 
Trust in legal system DOT LID “207 
Trust in police E92 Gs 1:92 
Trust in politicians ii Siam lnGz. mie S 
Trust in parliament 164 1.48 1.64 
Left-right scale TO sil OD amet 14) 
Satisfaction with life 2.06 1.74 2.06 
Satisfaction with education system 5,030 2.090 5.05 
Satisfaction with health system S967 SG 
Religiosity 1.94 1.75 1.94 
Attitudes to immigrants OTe 2268 225) 
Supports law against ethnic discrimination 2.82 2.85 2.82 
Importance of family 2A NO AT, 
Importance of friends 23h 2.09 2 
Importance of work DLO e216) 2.20 
Support people worse off 240 247 2210 
Always obey law 243 2.21 2.43 
Political activism B26) 2855, 220 
Liberalism 225 WAS 228 
Participation in groups 3.79 3.04, 375 


1.04 1.92 
1.08 
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6) © @& @ Oy oy (8) =) 


1.74 £.66:° "1206" -1.66--<1.66 LSl hag lable 1.42 
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LSD .reedss Suey 1 Zoya h3) 1 ioe Oded 60 41-61) 


LOZ e925. 1.92 1.025. LO lcOLe 1.01 
126.5 1:26 1.26. 26 107s 1055. 1.05. 105 
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1.62 150" “FSO PESO” TSO ia lO lla gsc ld 
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2.05 
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We have shown in section 4 above that use of alternative, 
simpler, methods of combining the domain-specific deffs 
does not always result in good estimates. In particular, the 
use of a convex combination will tend to result in an under- 
estimation, the extent of which depends on the extent of 
departure from the assumptions underlying the simplified 
expressions. In our empirical illustration, departures were 
modest, but it is easy to imagine designs with greater 
variation between domains in mean selection probabilities 
or in the distribution of design weights. We would therefore 
recommend that estimators (6)—(9) are used only if the 
assumptions genuinely hold, or if the sample design data 
necessary to calculate (5) is not available, in which case the 
analyst should at least make arbitrary allowance for under- 
estimation based on his or her knowledge of the design. 

An important issue that is outside the scope of this article 
is how to deal with non-response when predicting or 
estimating design effects for multiple design samples. The 
expressions throughout section 2 of this article refer to the 
number of observations, i.e., respondent sample units, in 
each domain, m,, and the calculations in sections 3 and 4 
are based on predicted numbers of observations and actual 
numbers of observations respectively. But the natural 
interpretation of the differences between the four scenarios 
in section 2 may be in terms of sample design, where the 
weights are design weights. Thus, scenario 2, for example, 
would refer to a design that is epsem within domains, but 
where the sampling fraction is permitted to differ between 
domains. However, in most realistic applications non- 
response will occur and may well be differential both 
between and within domains. This is often reflected in an 
adjustment to the design weight. Thus, the simplification of 
scenario 2 would only apply if the non-response adjustment 
were constant within domains, in addition to the design 
being epsem within domains. 

Scenario 3, if interpreted with respect to design alone, 
should always hold for any well-specified design in which 
the domains form explicit strata. Expression (8) is therefore 
equivalent to expression (5) in the absence of non-response. 
In the presence of non-response, scenario 3 requires that the 
(design-weighted) response rates are equal in each domain. 
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Similarly, scenario 4 requires that the net inclusion rate (the 
product of coverage rate, sampling fraction and response 
rate) is equal in each domain, whereas a design inter- 
pretation would not consider the response rate component. 
Appropriate ways to incorporate non-response adjust- 
ment into design effect estimation and, in particular, how 
that might effect estimation for multiple design samples, 
would appear to be an area worthy of further research. 
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GUIDELINES FOR MANUSCRIPTS 


Before having a manuscript typed for submission, please examine a recent issue of Survey Methodology (Vol. 19, No. 1 and 
onward) as a guide and note particularly the points below. Articles must be submitted in machine-readable form, preferably 
in Word. A paper copy may be required for formulas and figures. 


Layout 


Manuscripts should be typed on white bond paper of standard size (8%2 x 11 inch), one side only, entirely double 
spaced with margins of at least 12 inches on all sides. 

The manuscripts should be divided into numbered sections with suitable verbal titles. 

The name and address of each author should be given as a footnote on the first page of the manuscript. 
Acknowledgements should appear at the end of the text. 

Any appendix should be placed after the acknowledgements but before the list of references. 


Abstract 


The manuscript should begin with an abstract consisting of one paragraph followed by three to six key words. Avoid 
mathematical expressions in the abstract. 
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Style 


Avoid footnotes, abbreviations, and acronyms. 

Mathematical symbols will be italicized unless specified otherwise except for functional symbols such as “exp(-)” 
and “log(-)”, etc. 

Short formulae should be left in the text but everything in the text should fit in single spacing. Long and important 
equations should be separated from the text and numbered consecutively with arabic numerals on the right if they are 
to be referred to later. 

Write fractions in the text using a solidus. 

Distinguish between ambiguous characters, (e.g., w, @ ; 0, O, 0; 1, 1). 

Italics are used for emphasis. Indicate italics by underlining on the manuscript. 


Figures and Tables 


All figures and tables should be numbered consecutively with arabic numerals, with titles which are as nearly self 
explanatory as possible, at the bottom for figures and at the top for tables. 

They should be put on separate pages with an indication of their appropriate placement in the text. (Normally they 
should appear near where they are first referred to). 


References 


References in the text should be cited with authors’ names and the date of publication. If part of a reference is cited, 
indicate after the reference, e.g., Cochran (1977, page 164). 

The list of references at the end of the manuscript should be arranged alphabetically and for the same author 
chronologically. Distinguish publications of the same author in the same year by attaching a, b, c to the year of 
publication. Journal titles should not be abbreviated. Follow the same format used in recent issues. 
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In This Issue 


This issue of Survey Methodology opens with the sixth paper in the annual invited paper series in honour 
of Joseph Waksberg. It is with sadness that we note the passing of Joseph Waksberg in January of 2005. A 
short biography of Joseph Waksberg was given in the June 2001 issue of the journal, along with the first 
paper in the series. For more information about the life and work of Joseph Waksberg, see the Statistical 
Science article (Vol. 15, No 3) “A Conversation with Joseph Waksberg,” by David Morganstein and David 
Marker available at http://projecteuclid.org/Dienst/UI/1.0/Home. I would like to thank the members of the 
selection committee — David Bellhouse, chair, Gordon Brackstone, Sharon Lohr and Wayne Fuller — for 
having selected Alastair Scott as the author of this year’s Waksberg Award paper. 

In his paper entitled “Population-Based Case Control Studies”, Scott discusses the analysis of case 
control studies in which the controls are obtained from a complex sample survey. Using the example of 
logistic regression, he shows how the survey weighted estimates can be quite inefficient because of the 
relatively small weight given to the cases. Drawing on an analogy with maximum likelihood estimation, he 
then proposes a simple, much more efficient alternative that is, however, biased for the intercept term. 
Efficiency and robustness properties are illustrated through examples. Finally, he briefly discusses the 
problem of case-control family studies. 

Kott considers the use of weight calibration to correct for nonresponse and coverage errors. He gives a 
general description of calibration estimation, and extends Estavao and Sarndal’s functional form approach 
to general calibration. He then discusses properties of this calibration method to correct for unit 
nonresponse and coverage errors under a quasi-randomization model. He concludes with an empirical 
example and discussion of some issues. 

Reiter, Raghunathan and Kinney investigate through a simulation study the effect of ignoring sampling 
design variables when building imputation models in a multiple imputation context. They show that 
potential biases can be reduced by controlling for these design variables in the imputation model, either 
through a fixed-effect or mixed-effect model. They conclude that a useful prescription for imputers is to 
include as predictors all variables that are related to the variables being imputed, particularly sampling 
design variables, so as to make the usual assumption of ignorable non-response satisfied. 

The article by Funaoka, Saigo, Sitter and Toida investigates the use of bootstrap variance estimators in 
stratified multi-stage sampling where the sampling fractions are large. They propose a Bernoulli-type 
bootstrap that provides consistent bootstrap variance estimates when simple random sampling without 
replacement is used at each stage. The proposed method is simple to implement and can be extended to any 
number of stages without much complication. The method is illustrated through a limited simulation study 
and using data from the 1997 Japanese National Survey of Prices. 

In the Kozak and Verma paper, the geometric approach to stratification proposed by Gunning and 
Horgan (2004) is compared with two optimization approaches; the Lavallée-Hidiroglou algorithm 
(Lavallée and Hidiroglou 1988) and an optimization algorithm proposed by Kozak (2004). Using five 
artificial populations of various sizes, the three methods are compared under two scenarios; comparison of 
the resulting CV under a fixed sample size and comparison of the resulting sample sizes under a fixed level 
of precision. 

Deville and Lavallée present general theoretical foundations for the weight share method in indirect 
sampling. They define the important concept of a link matrix in indirect sampling, which specifies how the 
elements of the sampled population are linked to the target population and gives weights to these links that 
permit unbiased estimation. They discuss important properties of the link matrix, and derive necessary and 
sufficient conditions for an optimal link matrix to exist. The theory is illustrated with some interesting 
examples. 


A22 In This Issue 


Deville and Maumy-Bertrand study the determination of a sampling design and an estimation method 
for a tourist survey. The main issue that this type of survey has to address is the absence of a sampling 
frame that can be used to directly reach tourists. To get around this problem, authors suggest to sample 
services for tourists. This is thus a situation of indirect sampling for which the generalized weight-share 
method is used to obtain estimates of parameters of interest. Some extensions to the method become 
necessary. The authors focus more specifically on one of them and describe it in greater detail. 

Félix-Medina and Monjardin consider a variant of link-tracing sampling. They use a Bayesian approach 
to construct estimators of population size, however in order to make inferences about the population size 
that are robust to erroneous specification of the assumed model, the authors make inferences under the 
frequentist design-based approach. Based on the results of the simulation study, the proposed estimators 
perform better than the maximum likelihood estimators that are currently used. 

The paper by Dorfman, Lent, Leaver, and Wegman presents a comparison of the Consumer Price Index 
design methodologies of the United Kingdom and the United States employing the same “scanner” data. 
They conclude that in the population studied, the UK approach, which involves tighter stratification and, 
more importantly, more restrictive judgment sampling within strata than the probability sampling of the US 
approach, does better in estimating a target superlative index. This is shown to be the case, whichever low 
level price index estimator (the ratio of averages, the geometric mean, or the average of ratios) is employed. 

In their paper, Thomas, Raghunathan, Schenker, Katzoff and Johnson use multiple imputation to analyze 
data with missing values caused by a matrix sampling design. In matrix sampling, only a subset of 
questions is administered to each respondent in order to reduce respondent burden. The authors develop a 
method for creating matrix sampling forms, each form containing a subset of questions to be administered 
to randomly selected respondents. The method is designed so that each form includes questions that are 
predictive of the excluded questions in order to recover some of the information about the latter. The 
proposed method and multiple imputation are evaluated using data from the National Health and Nutrition 
Examination Survey. 


Harold Mantel, Deputy Editor 
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Population-Based Case Control Studies 


Alastair Scott ' 


Abstract 


We discuss methods for the analysis of case-control studies in which the controls are drawn using a complex sample survey. 
The most straightforward method is the standard survey approach based on weighted versions of population estimating 
equations. We also look at more efficient methods and compare their robustness to model mis-specification in simple cases. 
Case-control family studies, where the within-cluster structure is of interest in its own right, are also discussed briefly. 


Key Words: Case-control studies; Response-selective sampling; Retrospective sampling; Weighting. 


1. Introduction 


The case-control study, in which separate samples are 
drawn from ‘cases’ (people with a disease of interest, say) 
and from ‘controls’ (people without the disease), is one of 
the most common designs in health research. In fact, 
Breslow (1996) has described such studies as “the backbone 
of epidemiology”. We shall concentrate on biostatistical 
applications, but the basic design is an efficient sampling 
strategy whenever cases are rare and examples are common 
in many other fields as well (business, social science, 
ecology, market research, for example). In particular, there 
has been a parallel development of much of the theory in the 
econometric literature on choice-based sampling (see 
Manski and McFadden 1981, Cosslett 1981 for example). 

There are two fundamentally different types of case- 
control study: (set-)matched studies, in which each case is 
matched with one or more controls, and unmatched studies, 
in which the case and control samples are drawn indepen- 
dently, although there may be loose “frequency matching’, 
with the control sample allocated across strata defined by 
basic demographic variables in such a way that the distri- 
bution of these variables in the control sample is similar to 
their expected distribution in the case sample. We are only 
concerned with unmatched studies here and, more 
specifically, only with the restricted class of population- 
based studies in which the controls (and occasionally the 
cases as well) are selected using standard survey sampling 
techniques. 

An excellent introduction to the strengths and potential 
pitfalls of case-control sampling is given by Breslow (1996, 
2004). One of the most important and difficult challenges 
confronting anyone designing such a study is to ensure that 
controls really are drawn from the same population, using 
the same protocols, as the cases. In the words of Miettinen 
(1985), cases and controls “should be representative of the 
same base experience’. Failure to ensure this adequately in 
some early examples led to case-control sampling being 


regarded with some suspicion by many researchers. A 
comprehensive discussion on the principles that should 
govern the selection of controls is given in Wacholder, 
McLaughlin, Silverman and Mandel (1991). Since the 
essence of survey sampling lies in methods for drawing 
representative samples from a target population, it became 
natural at some stage to think about using survey methods 
for obtaining controls. Increasingly over the last 25 years or 
so, the controls (and occasionally the cases as well) are 
being drawn using complex stratified multi-stage designs. A 
good history of this development can be found in Chapter 9 
of Korn and Graubard (1999). 

The analysis of such studies is a particularly appropriate 
topic for this paper since Joe Waksberg himself was one of 
the principal drivers behind the adoption of survey methods 
(and random digit dialing, in particular) for obtaining 
controls (see, for example, Waksberg 1998 and DiGaetano 
and Waksberg 2002). 


2. Examples 


We start with two examples to illustrate the sort of 
problem that we want to handle. The first example is typical 
of the large scale studies conducted by the National Cancer 
Institute whose personnel have been responsible for much of 
the development of the area. Joe Waksberg, along with his 
colleagues at Westat, had a strong influence on the sampling 
methods used for these studies (see Hartge, Brinton, 
Rosenthal, Cahill, Hoover and Waksberg 1984, who also 
gives a description of a number of other similar studies) so it 
is a natural place to start. 


Example 1. 

In 1977-78, the National Cancer Institute and the US 
Environmental Protection Agency conducted a population- 
based case-control study to examine the effects of ultraviolet 
radiation on non-melanoma skin cancer over a one-year 
period (Hartge, Brinton, Rosenthal, Cahill, Hoover and 
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Waksberg 1984, Fears and Gail 2000). The study was 
conducted at eight geographic locations with varying solar 
ultraviolet intensities. Samples of non-melanoma skin 
cancer patients aged 20 to 74 and samples of general 
population controls from each region were interviewed by 
telephone to obtain information on risk factors. At each 
location, a simple random sample of 450 patients and an 
additional sample of 50 patients in the 20-49 age group 
were selected for contact. For the controls, 500 households 
were sampled at each location using Mitofsky-Waksberg 
random-digit dialing (Waksberg 1978). An attempt was 
made to interview all adults aged 65-74 as well as a 
randomly selected individual of each sex aged 20 to 64. In 
addition, a second Mitofsky-Waksberg sample of between 
500 to 2,100 households was taken and information 
gathered on all adults aged 65 to 74. This resulted in 
samples of approximately 3,000 cases and 8,000 controls, 
with the sampling rate for cases being roughly 300 times the 
rate for controls, depending on age. 

The second example is important to me personally since 
it first introduced Chris Wild and myself to the area. 


Example 2. 

The Auckland Meningitis Study was commissioned by 
the NZ Ministry of Health and Health Research Council to 
study risk factors for meningitis in young children which 
was reaching epidemic proportions in Auckland at that time 
(see Baker, McNicholas, Garrett, Jones, Stewart, Koberstein 
and Lennon 2000). The target population was all children 
under the age of nine in the Auckland region in 1997 — 
2000. 

All cases of meningitis in the target age group over the 
three year duration of the study were included in the study, 
resulting in about 250 cases. A similar number of controls 
was drawn from the remaining children in the study 
population using a complex multi-stage design. At the first 
stage of sampling, 300 census mesh blocks (each containing 
roughly 70 households) were drawn with probabilities 
proportional to the number of houses in the block. At the 
second stage, a systematic sample of 20 households was 
selected from each chosen mesh block and children from 
these households were selected for the study with varying 
probabilities that depended on age and ethnicity and were 
chosen to match the expected frequencies among the cases. 
Selection probabilities are shown in the table below: (PI 
means Pacific Islander) Cluster sample sizes varied from 
one to six and a total of approximately 250 controls was 
achieved. This corresponds to a sampling fraction of about 1 
in 400 on average, so that cases are sampled at a rate that is 
400 times that for controls here. 

These two studies are fairly typical of the sort of study 
that we want to discuss. They also illustrate the two main 
sampling methods used, namely random digit dialing and 
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area sampling. A lively discussion of the relative merits of 
these two strategies are given in Brogan, Denniston, Liff, 
Flagg, Coates and Brinton (2001) and DiGaetano and 
Waksberg (2002). 


Table 1 
Selection Probabilities 


AGE MAORI PACIFIC ISLANDER OTHER 


< | year 0.29 0.70 0.10 
Sy sveats ut Oaks 0.50 0.07 
SD Yeats ines OLS 0.31 0.04 
<i VEate a Osho 0.17 0.04 


3. General Set-Up 


Suppose that we have a binary response variable, Y, 
with Y = 1 denoting a case and Y = 0 denoting a control, 
and a vector of potential explanatory variables, x. We 
assume that the value of Y is known for all N units in 
some target population but that at least some components of 
x are unknown. We stratify the population into cases and 
controls, draw a sample from each stratum based on the 
variables that we know for all units, and measure the values 
of the missing covariates for the sampled units (in practice, 
the control sample is often drawn from the whole popu- 
lation, rather than the units with Y = 0. Ifthe proportion of 
cases is small, the difference will be negligible. Otherwise it 
is simple to adapt the results below to this variant — for a 
rigorous development, see Lee, Scott and Wild 2006). 
Typically, we then want to use the sample data to fit a 
binary regression model for the marginal probability of a 
being a case as a function of the covariates. The model used 
is almost always logistic with 


P(Y =1|x) 
P(Y = 0|x) 


= By + x’B, (1) 


say, where 8, and B, are unknown parameters, and we 
shall assume model (1) throughout the paper. Extensions to 
more general regression models are straightforward in 
principle (see Scott and Wild 2001b) but the resulting 
expressions are somewhat clumsier than those for the 
logistic model. 

How should we go about fitting the model (1) given 
sample data? Efficient methods are straightforward with 
simple or stratified random sampling, but we are interested 
in more complex sampling procedures here. Very often the 
complex sampling is simply ignored. Potentially, this could 
lead to all the usual problems that arise from ignoring 
sampling design structure. Varying selection probabilities 
can distort the mean structure and estimates produced by 
standard programs may be inconsistent. Intra-cluster 
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correlation can reduce the effective sample size so that 
routinely-produced standard errors are too small, confidence 
intervals are too short, p — values too low, and so on. A 
simple strategy that has been adopted by some researchers 
to minimize the effect is to keep the numbers of subjects in 
each cluster small (see Graubard, Fears and Gail 1989, for 
example). This reduces the design effect and hence the 
impact of clustering, but it can be a very expensive remedy. 
We look at some possible ways of coping with standard, 
more cost-effective, sampling schemes in the next few 
sections. 


4. Survey Weighted Approach 


One obvious possibility is to use the standard weighted 
estimating equation approach embodied in most modern 
packages for analyzing survey data (see Binder 1983). 
Suppose first that we had data from the whole finite 
population. If we assume this finite population is drawn 
from a superpopulation in which the conditional logistic 
model (1) holds, then we could estimate B by solving the 
whole-population or census estimating equations 


S(B) = Dx, — 71 (%,5B)) = 0, (2) 


where p,(x; B) = ef**"P: /(1 + eo**"B:). (These are the 
likelihood equations if population units are assumed to be 
sampled independently from a superpopulation but the 
resulting estimators are consistent under much more realistic 
population structures as long as model (1) holds 
marginally— see Rao, Scott and Skinner 1998 for more 
discussion. ) 

Now, for any fixed value of B, S(B) in equation (2) is 
just a vector of population totals. This means that we can 
estimate it from the sample, say by 


S(B) 7% > w;X;(¥; — P\(%;; B)), (3) 


sample 


where w, is the inverse of the selection probability, perhaps 
adjusted for non-response and post-stratification. Setting 
S(B) equal to 0 gives us our estimator, B. We could use 
linearization or the jackknife directly on B to get standard 
errors. Alternatively, we can expand S(f) about the true 
value, B, and obtain as our estimated covariance matrix the 
“sandwich” estimator 


Cov{B} = J(B)! Cov{S(B)} JB)", (4) 


where J(B) =— 08/OB? =Yampte W; Pi (%;5B) Po (%:5 B) X;X7 
with p, =1-p,. Since S(B) is a vector of totals, 
Cov{S(B)} should be available as a matter of course for 
any standard design. Most major statistical packages (for 
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example, SAS (PROC SURVEYLOGISTIC), SPSS 
(CSLOGISTIC), STATA (SVY:LOGIT), SUDAAN 
(LOGISTIC)) can handle logistic regression with com- 
plex sampling and weighting routinely these days. Thus 
producing weighted estimates and making associated 
inferences is reasonably straightforward. 

Strictly speaking, the selection probabilities will 
themselves often be random variables in our model-based 
framework, based on a finite population that we assume is 
generated from the model. We can account for this by using 
the results in Rao (1973), but the correction is of order 1/ N 
and can be ignored in most large studies. 

The downside of weighting in general is that it tends to 
be inefficient when the weights are highly variable. (A rule- 
of-thumb sometimes suggested is that w,,,, /W,,;, Should be 
no more than 10.) In case-control studies, the variation in 
weights is about as extreme as it can get. For instance, the 
ratio of w,,,, tO Win 18 approximately 300:1 in Example 1 
and approximately 1,000:1 in Example 2. Even more 
extreme ratios are not uncommon. No experienced survey 
sampler would be surprised to find that weighting is not 
very efficient under these circumstances. 

Can we do something more efficient? The answer is 
certainly “Yes” in some special cases. Fully efficient 
likelihood methods have been developed in situations where 
both cases and controls are drawn using simple or stratified 
random sampling and these can be very much more efficient 
than weighted methods. We review these results in the next 
section. 


5. Review: Simple Case 


We start with the very simplest case where cases and 
controls are selected by simple random sampling and we 
have no population information about any of the covariates 
at the design stage. Here fully efficient semi-parametric 
maximum-likelihood procedures are well-developed. More- 
over, these methods are very simple to implement using 
standard software (Prentice and Pyke 1979). (The methods 
are semi-parametric because the full likelihood depends on 
the unknown distribution of the covariates and we do not 
want to model this in general.) 

It turns out that all we have to do is fit model (1) using a 
standard logistic regression program without any weighting 
at all. More specifically, solving the unweighted equation 


> x0; - 2, (%; B)) = 9, (5) 


sample 


produces efficient estimates of all the coefficients except the 
intercept. Perhaps more importantly, all the standard errors 
and resulting inferences that we get from the standard 
program are also valid, again with the exception of anything 


Statistics Canada, Catalogue No. 12-001-XPB 


126 


involving the intercept. It is simple enough to correct 
inferences involving the intercept provided that we know 
the ratio of the two sampling fractions but we are often only 
interested in the other coefficients anyway. 

The results extend directly to stratified random sampling, 
provided that separate intercepts for each stratum are 
included in the model. Again efficient semi-parametric 
estimators of all coefficients except the stratum intercepts 
can be obtained simply by running the data through an 
ordinary (unweighted) logistic regression program. Again, 
the estimated standard errors and associated inferences are 
also valid. As with simple random sampling, we can correct 
the results for the stratum intercepts provided that we know 
the stratum sampling fractions but, again, these are usually 
of minor interest. 

Thus in these simple situations, maximum likelihood 
estimates are simpler to compute than the weighted 
estimates, as well as being more efficient. How much more 
efficient are they? This depends on the number of 
covariates, the magnitude of their coefficients and the ratio 
of the sampling fractions, but the difference is often 
substantial. (The weighted estimates are about 50% efficient 
in Example 2 of the introduction, for example, and less than 
20% efficient in the brain cancer example we look at in 
Section 8. Lawless, Kalbfleisch and Wild 1999 discuss 
situations where the efficiency 1s even lower than this.) 

Finally, we note that the maximum likelihood estimates 
have yet another advantage over weighted estimates: they 
tend to have much better small sample performance, 
especially in situations where the efficiency of the weighted 
estimates is low. Essentially, weighting results in a 
reduction in the effective sample size and it is this effective 
sample size that governs when the asymptotic theory starts 
to give a good approximation. (See Scott and Wild 2001a 
for more details.) Clearly we can pay a very heavy price for 
a rigid adherence to population weights. 


6. More Complex Sampling 


In both the examples in Section 2, the controls were 
obtained from a complex multi-stage survey rather than a 
simple random sample. As we noted in the introduction, this 
is increasingly common in large scale case-control studies. 
(Occasionally, as in Example 1, the cases are also selected 
using a complex sampling scheme.) It is possible to derive 
semi-parametric efficient estimators for stratified multistage 
sampling, assuming that primary sampling units are selected 
independently within strata (which is the assumption that all 
the computer packages are making with the survey- 
weighted approach anyway), but this requires us to build 
multivariate models for the vector of responses within a 
primary sampling unit. Details can be found in Neuhaus, 
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Scott and Wild (2002, 2006). Unless we are interested in the 
within-cluster structure in its own right (as in the family 
case-control studies considered in Section 9, for example), 
this requires far too much effort for it to be practicable, 
certainly for routine analysis. 

Can we do something simpler without losing too much 
efficiency? Weighted estimates are always available, of 
course. However, they are just as inefficient with complex 
designs as they are in the simple case considered in the 
previous section. It turns out that we can do considerably 
better without too much extra complication. 

Return for a moment to the situation of the previous 
section where we have a simple random sample of size n, 
from the case stratum and an independent simple random 
sample of size 1, from the control stratum. Here all units in 
Stratum ¢ have weight w, « W,/n,, where W, denotes 
the proportion of the population in the stratum, for / = 0,1. 
If we divide throughout by N and set p).(x;B) =1- 
DP, (x; B), then we can re-write equation (3) for the weighted 
estimator in the form 


» X; Po(X;; B) 
W, cases 


» xX; P, (x;; B) 
ty W, controls - 0. (6) 


nN No 


Similarly, we can write equation (5) for the efficient 
maximum likelihood estimator in the form 


Ds X; Po (X;; B) So x; P(%;; B) 
, cases — W controls = 0, (7) 
ny No 


where o, =7,/(n, + n,), for £= 0,1. Both these are 
special cases of the general set of estimating equations 


Si X; Po (x;; B) »! X, DP, (x;; B) 
r cases *s, a controls =) (8) 
fs Ng 


AS 1%, n, — ©, under mild conditions on the way that 
the finite population is generated from the superpopulation 
the solution of (8) converges almost surely to the solution 
B* of 


hy E\{X po(X; B)} — Ao Eo {X P(X; B)} = 0, 9) 


where £, {:} denotes the conditional expectation given that 
Y = @ for ¢ = 0,1. If model (1) is true, then equation (8) 
has solution B; =f, and 8, =B, +5, with 5b, = 
log(A,W,/,W,) for any positive A, A, (see Scott and 
Wild 1986 for details of the proof). Thus the solution to 
equation (8) produces consistent estimators of all the 
regression coefficients apart from the constant term for any 
X, > 0(¢ = 0,1). As in the simple case, it is easy to correct 
the inferences about the constant term, provided that we 
know the proportion of cases in the population. 
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Now turn to more complex sampling schemes. Since the 
left hand side of equation (9) just involves two sub- 
population means, we can still estimate these means for any 
standard survey design. This suggests an estimator, B.. say, 
for general sampling schemes satisfying 


S, (B) = A, fy, (B) - Ay fy (B) = 9, (10) 


where fi,(B) is the sample estimator of the subpopulation 
mean £,{X(1— p,(X; B))}(€ =0,1). The covariance 
matrix of B, can then be obtained by standard linearization 
arguments. This leads to an estimated (‘sandwich’) 
covariance matrix 


Cov {B,} = J,,B,)' Cov {S, (8, 35,68, GD 


with J,,(B) = (-€8, (B)/0B7) and Cov{S, (B)} = 
A? Cov{fi, (B)} + 45 Cov{f(B)}. Here, Cov{f, (B)} 
denotes the usual survey estimate which should be available 
routinely for any standard survey design since fi,(B) 1s just 
an estimated mean. 

All of this can also be carried out straightforwardly in 
any package that can handle logistic regression for complex 
survey designs simply by specifying the appropriate vector 
of weights. More specifically, suppose that 

Di W, X; ; Tal (x; B)) 


ieS, 


PN eet Dae crete pa enc 
Ds YW 


ieS, 


p(B) = (12) 


where S, denotes the case subpopulation (i.e., the set of all 
units with Y=1) and S, denotes the control sub- 
population (the set of all units with Y = 0). Then the 
estimating equation (9) can be written in the form 


S,8) = 2) wi xi(% — Gs B) =, (13) 
sample 

with w; o A,w,/ Dies, w, for units in S,(¢ = 0,1). In other 
words, we simply have to scale the case weights and control 
weights separately so that the sum of the case weights is 
proportional to 4, and the sum of the control weights is 
proportional to 2, and put them, along with the usual 
specification of the design structure (strata, primary 
sampling units), into our program of choice. Note that the 

choice of proportionality constant does not affect the result. 
We still have to decide on good values for A, and Ay. 
We can often get substantial gains using sample weights 
(A, =n,/n) compared with using population weights 
(A, = W,). Scott and Wild (2002) report efficiency gains of 
50% or more in Example 2 and in simulations based on that 
population. The gains became larger as the strength of the 
relationship increased, and as the effect of clustering 
increased. Moreover the coverage of confidence intervals 


ae 


was closer to the nominal value for sample weighting in the 
simulations. 

Using sample weights is the most efficient possible 
strategy when we have simple random samples of cases and 
controls but for more complex schemes using the sample 
weights will no longer be fully efficient. We might expect 
weights based on some form of equivalent sample sizes to 
perform better. This does indeed produce some gain in 
efficiency in some limited simulations reported in Scott and 
Wild (2001a). However, the gains are relatively small, at 
least when the control sample design effect is less than 2, 
since Covi, } is very flat as a function of A near its 
minimum. Considerations of robustness that we discuss in 
Section 8 are possibly more important in the choice of 2. 

The gains from sample weighting may depend very 
much on the particular problem under examination. Korn 
and Graubard (1999, page 327) comment that, in their 
experience, the sample weighting strategy rarely produces 
big gains in efficiency. Obviously more work, both 
empirical and theoretical, is needed here. In any event, it 
would seem prudent to fit the model using both sample 
weights and population weights routinely. If the coefficient 
estimates are similar, then we can make a judgement based 
on the estimated standard errors. However, significant 
differences in the coefficient estimates indicate that the 
model has been mis-specified. If we are unable to fix up the 
deficiencies in the model, then we need to think very 
carefully about just what it is that we are trying to estimate. 
We look at this again in Section 8. 


7. Stratified Sampling 


The compromise suggested in the previous section (i.e., 
use standard survey weighting within the subpopulations 
defined by case/control status but combine the sub- 
populations using sample proportions) seems to work 
reasonably well in practice but it is all completely ad hoc. 
Could we do better with a more systematic approach? 

In the special case of stratified random sampling, where 
independent case-control samples are taken within each 
stratum, fully efficient procedures are well-developed and 
easy to implement. In particular, if our model includes a 
separate intercept for each stratum, then ordinary 
unweighted logistic regression (with a simple adjustment for 
the stratum intercepts if they are wanted) is the efficient 
semi-parametric maximum likelihood procedure (Prentice 
and Pyke 1979). It is reasonably straightforward to extend 
this to more general stratified designs. Our model is now 


logit {P(Y =1| x, Stratum h)} = B,, + x7B,, (14) 
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and the stratified equivalent of the estimating equation (7) is 


» X; Pon, (X;; B) a XP, (%;; B) 
Si 1 sy ba controls 


h Np, Nop 


= 0.(15) 


AS 1,5. 1, — ©, the solution of (7) converges almost 
surely to the solution of 


pase: Ey, t{X Pon(X; B)} 
h 
— Aon Eo {X P, (X; B)}) = 0, (16) 


with the obvious extension of the notation from the 
unstratified case. If model (13) is true, then equation (8) has 
solution 6. = 6, oS0d Go, = Dae ys WEED Dee = 
log (Ay, Vo, /Ao, W,,). Since equation (14) only involves 
stratum means, we can estimate them easily using the data 
coming from any reasonable survey design, for example by 


ye, Win Xin Vin — Pi Xin s BY) 
f.,,(B) = 
. ny Win 


ieS,, 


Substituting these estimators in place of the sample means 
in equation (14) leads to the estimating equation 


S,.(B) = > ow, x;0% — Pp (x;3 B)) = 0, (17) 


h ieS, 


with w), © A.,W,/ Dies, Wy, for units in S,,(€ = 0,1; 
h=1,..., H). This can be fitted in any standard survey 
program by including these weights and the appropriate 
design information. Note that we need to be careful about 
how we include the so-called ‘strata’ in the design 
specification. If primary sampling units are nested within 
the ‘strata’, as with the geographical locations in Example 1, 
there is no problem and the strata should be included in the 
standard way. However, if the primary sampling units cut 
across the ‘strata’, as with age in Example | and age and 
ethnicity in Example 2, then these are not strata in the usual 
survey sampling sense. They should not be included in the 
design specifications but simply handled through the 
weights. 

Sometimes we want to model the contribution of the 
stratum variables using some smooth parametric curve 
rather than including them through dummy variables. For 
example, we might well want to include a linear function of 
age in our model in both Examples 1 and 2. The survey 
weighted method and the compromise weighting suggested 
in Section 6 both apply directly and no new theory is 
needed. More efficient methods are not nearly so simple, 
however. Fully efficient methods have been developed in 
the case where simple random samples of cases and controls 
are drawn within each of the strata (see Scott and Wild 
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1997, and Breslow and Holubkov 1997) but the resulting 
estimating equations are not linear combinations of stratum 
means and there is no obvious way of generalizing them to 
more complex sampling schemes. There is a slightly less 
efficient way that does extend easily, however. If we modify 
model (14) by including 6,, = log(A,, Wo, /Ao, W,,) as an 
offset, i.e., we set 


logit{P"(Y =1| x, Stratum h)} = 6, + By, + x7B,, (18) 


then equation (15) produces consistent, fully efficient, 
estimates of all the coefficients including B),(/ = 1,..., 
#7). Including the same offsets in models where there is no 
Bp, term and the x vector includes functions of the 
stratifying variable produces consistent estimators of all the 
coefficients with typically high (although not full) efficiency 
(see Fears and Brown 1986, and Breslow and Cain 1988). 
This generalizes to arbitrary designs immediately. We just 
use equation (16) with p,, replaced by p,, defined by 
setting logit(p;,) = 5,, + x’B. Then any survey program 
that caters for offsets can be used to fit the model and 
provide estimated standard error, etc. 

How much extra efficiency do we get in this case? We 
have carried out a number of simulations, some of which are 
reported in Scott and Wild (2002). Most of the scenarios are 
based on the meningitis study in Example 2 and we set the 
ratio of the largest to smallest stratum sampling fraction in 
the control sample at about 10:1. Without any clustering, the 
gain in efficiency from using the offset method (which is 
full maximum likelihood in this case) compared to the 
ad hoc procedure was never more than 10%. The relative 
efficiencies stayed about the same as clustering that cut 
across strata was introduced. When clustering nested within 
strata was introduced, the gains disappeared progressively 
as the design effect increased and the adhoc procedure 
actually became more efficient than the offset method when 
the design effect reached about 1.5. 

As we stated earlier, it is possible to produce fully 
efficient semi-parametric estimators if we are willing to 
model the dependence structure within primary sampling 
units. We have begun to carry out some simulation. The 
early results suggest that the extra work involved in the 
modeling will almost never be worth the effort if we are 
only interested in the parameters of the marginal model (1). 
Our tentative conclusion is that, the adhoc partially 
weighted procedures (with sample weights) are simple to 
use and work well enough for most practical purposes in the 
range covered by our experience but this is another area 
where more empirical work is needed yet. We note, 
however, that there are some problems, like the case-control 
family design discussed in Section 9, where the within- 
cluster behavior is of interest in its own right. These require 
more sophisticated methods. 
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There must be a catch somewhere. What if the model is 
not correct? What price do we pay for efficiency then? 

By its construction, the population-weighted estimator is 
always estimating the linear logistic approximation that we 
would get if we had data from the whole population. By 
contrast, what the more efficient sample-weighted estimator 
is estimating depends on the particular sample sizes used. 
Some people would regard this alone as a strong enough 
reason for using the population weighted estimator and I 
suspect that very few people would regard it as completely 
satisfactory to have the target of their inference depend on 
the arbitrary choice of sample size. 

Our general estimator B. satisfying (10) converges to the 
solution of equation (9), B, say, with y = Ay /(Ag + A,), 
which depends on the true model and distribution of the 
covariates, as well as on y. In Scott and Wild (2002), we 
looked at what happens to B, under mild deviations from 
the assumed model. (We are interested in small deviations 
since large ones should be picked up by routine model- 
checking procedures and the model then improved.) For 
simplicity, suppose that we fit a linear model with a single 
explanatory variable for the log odds ratio but that the true 
model is quadratic, say 


Negative Quadratic 
logit(x) = By + 4x - 0.6x2 
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logit{P(Y =1|x)} =P, +B,x+8x2 (19) 


with 6 small. 

Obviously, the actual slope on the logit scale, B, + 26x, 
changes as we move along the curve. For any 0 < y < 1, 
B,, is equal to the actual slope at some point along the 
curve. Denote this value by x = x,. Let x, be the expected 
value of x in the control population and let x, the expected 
value of x in the case population. We shall assume that 
B,; > 0 so that x) < x,. It turns out that x, always lies 
between x, and x,.and that x, increases as y increases 
from 0 to 1. Recall that survey weighting corresponds to 
y=W, and sample weighting to y=, =n,/n. 
Typically, W, is much larger than @, so that survey 
weighting gives an estimate of the slope at larger values of 
x, where the probability of a case is higher, while the slope 
estimated from sample weighting is closer to the average 
value of x in the population. Figure 1, adapted from Scott 
and Wild (2002), illustrates the position in two scenarios, 
one with positive curvature and one with negative, based 
roughly on Example 2. The value of 5 is chosen so that it 
would be detected with a standard likelihood ratio test about 
50% of the time if we took simple random samples of 
Ny =n, = 200 from the population. 


Positive Quadratic 
logit(x) = Bo + 2x - 0.3x? 


(By =-9.21 


- 
- 
* 
* 
Ps 
o* 
* 


a Population: B, = 1.89 
B, = 2.61 


logit pr (Y= 1 | x) 
logit pr (Y= 1 | x) 


Equal: 


1 in 400 — 


| (b) By = -9.44 
> Population 


Equal 


Population: B, = 3.25 
B, = 2.77 


Equal: 


Figure 1. Comparison of population and equal weights. 
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In both scenarios, the value of B,) is set so that the 
proportion of cases in the population is 1 in 400, i.e., so that 
W, = 0.9975. The overall density of x is shown at the top 
of the graph and the conditional densities for cases and 
controls are shown at the bottom. Values of x, and B,, are 
shown for y = W, (labeled “population”) and y = 0.5 
(labeled “‘equal’”). The latter value corresponds to sample 
weighting if we draw equal numbers of cases and controls. 
Clearly, survey weighting is estimating the appropriate 
slope for values of x further out in the upper tail of the 
distribution (i.e., for individuals at higher risk) than equal 
weighting in both scenarios. 

Note that if we took simple random samples of n) = 
n, = 200 from the population in Figure 1 (a), the relative 
efficiency of survey weighting is only about 16%, and the 
small sample bias is 0.24. In this case, even if we take the 
population value as our target, the survey weighting leads to 
a larger mean squared error than sample weighting. 

More results are given in Scott and Wild (2002) where 
we also look at the effect of omitted covariates. This turns 
out to have a similar, but somewhat smaller, effect to 
omitting a quadratic term. 

Which is the right value of y to use? That clearly 
depends on what we want to use the resulting model for. If 
our primary interest is in using the model for estimating 
odds ratios at values of x where the probability of a case is 
higher, and the sample is large enough so that variance and 
small sample bias are less important, we might use 
population weights. For smaller sample sizes, or if we are 
interested in values of x closer to the population mean, 
sample weights would be better. A value intermediate 
between population weighting and sample weighting might 
sometimes be a sensible compromise. For example 
trimming the weights to 10:1 (Ze., setting y ~ 0.91) in the 
example, instead of 1:1 (sample weighting) or 400:1 
(population weighting), leads to an efficiency of 70% and a 
small sample bias of 0.04. The corresponding values for 
population weighting were 16% and 0.24. The value of 
X91 lies almost exactly half way between x), and Xp 9975. 


9. Case-Control Family Studies 


If we are primarily interested in the parameters of the 
marginal model (1), then the methods that we have discussed 
in previous sections are simple to implement and reasonably 
efficient. Fully efficient methods require building parametric 
models for the within-cluster dependence and the extra effort 
that this would entail is rarely worthwhile. However, there 
are situations where the dependence structure is of interest in 
its own right. In particular, it has become increasingly 
common for genetic epidemiologists to augment data from a 
standard case-control study with response and covariate 
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information from family members, in an attempt to gain 
information on the role of genetics and environment. This 
can be regarded as a stratified cluster sample, with families 
as clusters, and the intra-cluster structure is of the primary 
focus of attention here. The following example is fairly 


typical. 


Example 3. 

Wrensch, Lee, Miike, Newman, Barger, Davis, Wiencke 
and Neuhaus (1997) conducted a population-based case- 
control study of glioma, the most common type of 
malignant brain tumor, in the San Francisco Bay Area. They 
collected information on all cases of glioma that were 
diagnosed in a specified time interval and on a comparable 
sample of controls obtained through random digit dialing. 
They also collected brain tumor status and covariate 
information from family members of the participants in the 
original case-control sample. There were 476 brain cancer 
case families and 462 control families in the study. 

We could use the methods that we have been discussing 
to fit a marginal model for the probability of becoming a 
glioma victim but a major interest of the researchers was the 
estimation of within-family characteristics. One way of 
approaching this would be to fit a mixed logistic model with 
one or more random family effects. 

Note that, strictly speaking, the original sampling scheme 
in Example 3 is not included in this case-control set-up. The 
stratification here is related to the response variable but not 
completely determined by it. Stratum 1 contains the 476 
families with a case diagnosed in a particular small time 
interval while Stratum 2 contains the remaining 1,942,490 
families, some of which contain brain cancer victims. 

In Neuhaus etal. (2006) we develop efficient semi- 
parametric methods for stratified multi-stage sampling in 
situations where the stratification depends on the response, 
possibly in an unspecified way that has to be modeled, and 
observations within a primary sampling unit are related 
through some parametric model. The estimates require the 
solution of p +1 estimating equations, where p is the 
dimension of the parameter vector. The covariance matrix 
can also be estimated in a straightforward way using an 
analogue of the inverse observed information matrix. The 
whole procedure can be implemented using any reasonably 
general maximization routine but this still requires some 
computing expertise. 

We could also fit the same models using survey weighted 
estimators, which has the big advantage of requiring no 
specialist software. In our example, case families would 
have weight 1 and control families would have weight 
1,942,490/462 ~ 4,200. With such a huge disparity, we 
might expect the weighted estimates to be very inefficient 
indeed. Unfortunately it turned out to be almost impossible 
to fit an interesting model for which the weighted estimates 
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converged. One problem is that the weighted estimates are 
based almost entirely on the control sample and there is very 
little information about family effects in the control families. 
(Another problem is that we did not have information on 
age for family members and any model without age was 
grossly mis-specified!) For this reason, we had to resort to 
simulation which is far from complete at this stage. It seems, 
however, that the efficiency of weighted estimates is less 
than 10% of the efficient semiparametric estimates here. 
More details are given in Neuhaus ef al. (2002, 2006). 
Although our simulations are at a very early stage, it is 
possible to draw a few tentative conclusions. The main one 
is that within-family quantities are very poorly estimated, 
even using fully-efficient procedures. Case-control family 
designs, where the information on family members is 
obtained as an add-on to a standard case-control design, 
simply do not contain enough information to estimate the 
parameters of interest to genetic epidemiologists unless the 
associations are extremely (even unrealistically) strong. (I 
should note that not all genetic epidemiologists would agree 
with this.) More efficient variants are possible, however. For 
example, if we can identify families containing more than 
one case, then it is possible to get much greater efficiency 
by heavily over-sampling such families. In essence, we 
would be taking the family as the sampling unit, defining a 
‘case family’ as one containing multiple individual cases 
and then taking a case-control sample of families. This is an 
important area where a lot of work still needs to be done. 


10. Conclusion 


The population-based case-control study is one of those 
subjects where practice has forged ahead of theory. As far as 
I know, the only book that discusses the topic in any depth 
is Korn and Graubard (1999, Chapter 9). One aspect that has 
received a reasonable amount of theoretical attention in the 
literature is stratification. Efficient procedures for 
incorporating stratifying variables in the analysis have been 
developed by Scott and Wild (1997), Breslow and 
Holubkov (1997), and Lawless et al. (1999), among others, 
when the variables can take only a finite set of values. 
Breslow and Chatterjee (1999) have considered how best to 
use such information at the design stage. The extension of 
all this (both analysis and design) to situations where we 
have information on continuous variables such as age for all 
members of the population is an area that still needs work. 
Much less has been written on the effect of clustering, even 
though multi-stage sampling is in common use. Exceptions 
are Graubard et al. (1989), Fears and Gail (2000) and Scott 
and Wild (2001a). Perhaps this paper might stimulate more 
work on an important topic. In particular, since the essence 
of the problem boils down to estimating two population 
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means (see equation (8)), it should be possible to transfer a 
lot of the expertise about efficient survey design across to 
this problem. 
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Using Calibration Weighting to Adjust for Nonresponse and 
Coverage Errors 


Phillip S. Kott ' 


Abstract 


Calibration weighting can be used to adjust for unit nonresponse and/or coverage errors under appropriate quasi- 
randomization models. Alternative calibration adjustments that are asymptotically identical in a purely sampling context can 
diverge when used in this manner. Introducing instrumental variables into calibration weighting makes it possible for 
nonresponse (say) to be a function of a set of characteristics other than those in the calibration vector. When the calibration 
adjustment has a nonlinear form, a variant of the jackknife can remove the need for iteration in variance estimation. 


Key Words: Prediction model; Quasi-randomization model; Quasi-randomization consistent; Instrumental variable; 


Generalized raking. 


1. Introduction 


Calibration weighting was originally developed as a 
method for reducing sampling errors while retaining 
randomization consistency. Deville and Sarndal (1992) 
demonstrated that many alternative forms of calibration 
weighting are asymptotically identical in the sampling 
context. This lead to a breakthrough in our understanding of 
common weight adjustment methods like raking that do not 
appear in generalized-regression (GREG) estimator format. 

Folsom and Singh (2000) showed that calibration 
weighting can also be used to adjust for known coverage 
errors and/or unit nonresponse under appropriate quasi- 
randomization models. Their work is not in the refereed 
literature. The heart of this article repeats key results in 
Folsom and Singh including a necessary modification of the 
Deville-Sarndal approach to model variance/randomization 
mean-squared-error estimation in this expanded context. An 
earlier, strictly linear version of calibration weighting for 
unit-nonresponse adjustment can be found in Fuller, 
Loughin and Baker (1994). See also Lundstrém and Sarndal 
(1999). 

A distinction is drawn between the prediction model 
usually underpinning calibration and the quasi-randomiza- 
tion model in Folsom and Singh. Unlike in Folsom and 
Singh, however, both properties are explored here. Further- 
more, the explanatory variables in the quasi-randomization 
model are allowed to differ from the calibration variables. 
This is likewise allowed in Lundstrém and Sarndal. 

A new jackknife is proposed which is analogous to the 
Deville-Sarndal linearization variance estimator. It employs 
replicate weights computed in one step even though the cali- 
bration weights themselves may be determined iteratively. 

After introducing the popular notion of calibration 
weighting, Section 2 provides a review of the GREG special 


case in a purely sampling context. Section 3 describes 
Estevao and Sarndal’s (2000) extension of calibration 
weighting in its linear form to include instrumental 
variables. Section 4 expands Deville and Séarndal’s treat- 
ment of calibration weighting to include the possibility of 
instrumental variables. Section 5 reviews variance/mean 
squared error estimation, proposing a new jackknife for 
certain designs. Section 6 describes how calibration 
weighting can be used to adjust for nonresponse. In this 
context, alternative functional forms of calibration 
weighting need no longer be asymptotically identical. 
Section 7 discusses quasi-randomization models for 
coverage errors, that is, frame under- or over-coverage. 
Section 8 contains a small empirical example supporting the 
new jackknife. Section 9 provides a discussion of alternative 
approaches and areas for future research. 


2. Calibration Weighting and 
the GREG Estimator 


Suppose we knew the selection probability, 1,, for each 
sample element k in the sample S. We can estimate any 
population total, T, = iy y,, where U denotes the popula- 
tion, with the expansion estimator typ = Ls! Mm = 
Xv YL, /m,, where J, =1 when keS and 0 otherwise. 
Treating the 7, as random variables, it is easy to see that 
t, , 1s an unbiased estimator for 7,. Properties arising 
when the /, are treated as random variables are called 
randomization-based. We can also write t, ¢ = Ly 4), = 
say, Where a, =J,/nm, is the sampling weight of 
element k. 

Deville and Sarndal (1992) coined the term “calibration 
estimator” to describe an estimator of the form 
ty car =Ls WY, Where Vs w,xX, = Ly X, =7, for some 
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row vector of auxiliary variables, x, =(%,,..., Xp, ), about 
which 7, is known. Since there is generally a continuum of 
sets {w,|k € S} that satisfy the calibration equation: 
Ms w,.X, =; (1) 
keS 
Deville and Sarndal required that the difference between the 
set of weights, {w,|k eS}, satisfying equation (1) and 
{a,\k € S} minimize some loss function. 
An alternative approach to survey sampling treats the y, 
as random variables satisfying the linear prediction model: 


y,=X, B+, (2) 


where E(¢e,|{x,,/,|g<U})=0 for all keU. By 
conditioning this expectation on the /,, we are assuming 
the sampling mechanism can be ignored. This is a crucial, 
and sometimes unreasonable, aspect of the (prediction) 
model-based framework. 

It is easy to see that 7, ca, is an unbiased estimator for 
T, under the model in the sense that E.(¢, ca, —7,) =0 
(suppressing the conditioning for notational Seonyenidneey 
the subscript ¢ refers to treating the ¢, as random variables 
(and the /, as fixed constants). 

For our purposes, the general(ized) regression or GREG 
estimator has the form: 


ty GREG GE 


Bt 
a G rr we an (D Cp A,X, Xj | Ds CLAX Vy (3) 
keS keS keS 
where c, is an arbitrary constant which may or may not be 
atunction’ of@x,, sand "limyy. yy, cokes, /N =A ls’ a 
positive definite matrix, where N is the size of U. This last 
condition means that > c,a,x,x, will usually be 
invertible in practice. We will assume that it is always 
invertible for convenience. 

The GREG estimator in equation (3) can be rewritten in 
calibration form as ¢,, grag = Ls Wy, ,, Where 


s) 

W, =a, + {r,- sy 4X AE ax] BVIES Ge 
JeS jeS 

Strictly speaking, the w, are functions of the realized 

sample, S, and the c,a,, but we suppress that in the notation 

for convenience. Observe that the calibration weights can be 

expressed as 


WwW, =a, (1+ C,X,), (4) 


where q =[(d's Dex Kyi ma a,x)’ 
vector, since x,q = q’X;. 

Let us assume that reasonable regularity conditions hold 
(see, for example, Kott 2004a for a more thorough treat- 
ment) and the sample plan is such that ¢, , —T, = 
OLN gs Jn), where n is the expected size of S (ihe 2 
size can be random), >, a,x, —T, =0,(N/Vn), and 


is a column 
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—~Yy cxf, =O,(N/Vn), where f, can be 

—x,(Xy ¢x/x;) Xp ¢x!y,, so that 
Yu exe, =0, and D,a,c,xie, =O,(N/Vn). We can 
express the error of 7, garg as 


T 


L, GREG a yeeety, 


=D WY € 


Ys 4,0, X;f, 
x, or y,. Let e, =y, 


DV 


keS keU 
= bY We — y ey sine Ds w,X;, = oy 4 

keS keU keS keU 

=f 

a Degent z Ya | > seri ye AC Xp ey 

keS keS keS keS 

ko Di e 
keU 

= Me Dea > e, + OP(N/n). (5) 


keS keU 


It is now not hard to see that the GREG estimator is 
randomization —— consistent; that. 9 gis: plim,, ,.. 
[(t, crec ~2,)/N]= Moreover, both the relative 
randomization bias and relative randomization mean 
squared error of the GREG estimator are order 1/n. Since 
mean squared error =bias* + variance, we can conclude 
that the randomization bias of the GREG estimator is 
usually an asymptotically insignificant contributor to its 
mean squared error. 


3. Redefining Calibration Weights 


In their original definition of calibration weights, Deville 
and Sarndal (1992) required that the set of calibration 
weights, {w,|k eS} minimize some distance function 
between the members of the set and the original sampling 
weights, the a,, subject to satisfying the calibration 
equation. As a result, the calibration estimator, ¢, car = 
ds W;,¥;,, Was both unbiased under the model in equation 
(2) and usually randomization consistent. 

Estevao and Sdérndal (2002) suggested removing the 
requirement that the calibration weights minimize a distance 
function. Instead, they essentially proposed that the w, need 
only satisfy the calibration equation and be of the 
“functional form:” 


w, =a,(1+h, q), (6) 


where h, is a row vector with the same dimension as x, 
such that >°, a,h),x, is invertible, and q is a column vector 
of that same dimension. Equation (6) is a mild generaliza- 
tion of (4) where h, effectively replaces c,x,. 

It is not hard to see that q=[(dXs Sea re 
(To Dic a % ay Moreover, under mild conditions we as- 
sume to hold, ¢, cap = Ls Wy = Ls UY, +, — Ls 4;X;) 
(Xs ahi x,) 2s a, hy, is randomization consistent 
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whenever ¢, , is. It is unbiased under the linear prediction 
model in equation (2) when E(€,|{x,,h,|geS}, 
{I,|g €U})=0 forall k EU. 

This suggests another alternative definition of calibration 
weights: a set of weights, {w,|k €S}, such that, 


i. the w, satisfy the calibration equation for {x,|k ¢U} 


and, 


li. t, car = Ls WY, 18 randomization consistent whenever 
t,, , is under mild conditions. 


That is the definition we will use. This broadened definition 
of calibration weighting will prove very helpful when using 
calibration to adjust for nonresponse or coverage errors. 

It follows from our new definition that Estevao and 
Sardnal’s functional-form calibration is indeed a form a 
calibration weighting. Borrowing from econometric theory, 
the components of h, that are not linear combinations of 
components of x, are called “instrumental variables.” 


4. Possibly Nonlinear Calibration 


Building on ideas in Deville and Sarndal (1992), we can 
generalize the linear form for the calibration weights in 
equation (6) to 


WV GEN a, f (h, q ), (7) 


where f is a monotonic, twice-differentiable function with 
f(0)=1, f'(0)=1 (f'(0)_ is the first derivative of f 
evaluated at 0), and q is chosen so that the calibration 
equation holds. Unlike the calibration-weight equation 


above, the calibration equation itself, Sw,x, =T,, 
remains linear. Note that since f(0)=1, f’(0)=1, 
f(h,q )~1+h,q. 


Strictly speaking, there should be an additional symbol 
On W, cen (and later on w, ;,) to denote the particular 
choice of h,. It has been dropped for convenience. 

A solution, q', to equation (7) can often be reached 
iteratively. One can start with q‘° =0; that is, Ys Meee Nee 
where w= a, f(0). For r=1,2,..., one then sets q= 

a HE. f'(h, q’ ” Ya,xih pl HCE = ae x,), and 

= a. _S(h,q°”). Iteration stops at r when T.= 

. s wx, for all practical purposes. One should be aware, 

however, that there may not be a set of weights that can be 

expressed in the form of equation (7) while satisfying the 
calibration equation. 

Note that q‘?’ above equals the q in w, pn=G 
(1+h,q). A Taylor expansion around zero reveals 
fh,q”) =l]+ h,q”” + O,(1/n) under mild conditions, so 
Ls, = Ds We unde + Op(N/n) = T, [1+ Op(1/n)]. 
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Furthermore, it is not difficult to see that w, Gp = 
W, yn[1+O,(1/n)], an equality that proves helpful in 
variance estimation. 

The most common example in practice of a nonlinear fis 
f (h,q) = exp(x,q), where the values of each of the 
components of x,, denoted x,,,...,xp,, are either 0 or 1. 
That is effectively the form of Deming and Stephan’s 
(1940) raking weights computed via iterative proportional 
fitting. Many have observed that the iterative routine 
described above can be used even when the components of 
x, are not binary as they are in Deming and Stephan. Note 
that the generalized raking calibration weights that result are 
always nonnegative. 


5. Variance Estimation 


Sarndal, Swensson, and Wretman (1989) proposed this 
plug-in model variance/randomization mean-squared-error 
estimator for ¢, greg under an arbitrary sampling plan: 


=) ley — ay) )/ 0, 10,74,)00,7))." @) 


keS jeS 


Yssw 


The term derives from 7, being “plugged into” vey in 
place of the unknown e, = y, —x,(Xy h’x,)' Dy hiy, for 
randomization-mean-squared-error estimation. 

Paralleling arguments in Deville and Sarndal (1992), 
Vssw also applies more generally to ¢,, 4, with calibration 
weights defined by equation (7) with 


“ 
r=), -X; [s ows, 2 ajh’x. (9) 
je je 


This’ -Yis / *heeatse ww, a =v ey nil Os din)], © so 
LisWe_GEn& = Ls _uin e, + Op(N/n) = Dsa,e, + Op(N/n). 
The last step uses reasoning exhibited in equation (5) with 
h, serving in place of the c,x, 

“A their article, Deville aa Sarndal effectively replace 
the a, in equation (9) with w, =a,f(h,q "). A different 
version is given in Demanti anid ee (2004), where the a, 
in the equation are replaced by a, /'(h,q bi sons Navi Pater 
noted in a comment accompanying the ed that all three 
versions of the 7, are asymptotically identical since /(0) = 
f'(0)=1 and q_ is asymptotically 0. These asymptotic 
identities may no longer hold when calibration weighting is 
used to adjust for nonresponse as we shall see in the 
following section. 

Developing asymptotic properties for Vecy under 
stratified simple random sampling is a simple matter. In this 
context, Veow set ars to 


Ysri = aC [114 p> (l-n,/N,) 


4 


x | Wee DL Wir! Ma | 
jeS, 
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where S, denotes the sample of , units in stratum 
a(a=1,...,A), and U, the stratum population containing 
N,, elements. 

For a multi-stage sample it makes sense to allow the 
possibility that ¢, and ¢, in the prediction model are 
correlated when k and j are elements in the same PSU, but 
not otherwise. When finite-population correction can be 
ignored, the model variance of a calibration estimator is 
approximately V,, = Dies E.[(Q&cesciy w,€,)] under mild 
conditions, where S(i) is the set of sampled elements in 
PSU i, and S$" is the set of PSUs selected in the first stage of 
sampling. 

The following variance estimator, not strictly equal to 
Vgsw> Often has good randomization and model-based pro- 
perties (when the first-stage selection probabilities are all 
small): 

A 


Vera y (Helle) 


a=] 


ey) LP) 


2 
2 De » Wa 
| JES, KES; 


Ny 


es {zm 


TES 4 keS,j 


where a denotes a first-stage stratum of PSU’s, n,, the 
number of sampled PSU’s in stratum a,S, the set of 
sampled PSU’s in a, and S,, the set of subsampled 
elements from PSU 7 of stratum a. There can be many 
stages of sampling involved. 

It is not hard to show that v,;, 1s asymptotically indistin- 
guishable from the jackknife variance estimator: 


— 


Leia 3 ([7, ning >» (4, cats) “4, cxf (11) 


= JESy 


where ¢, car(aj) = Likes Wea; Ye and the jackknife repli- 
cate calibration weights are 


Wraj)— Wik (aj) /ay, | yi 2 » Wh [Qin(cxi) lag} 


meU meS 


-1 
s [> eal Anco) My: (12) 


meS 


where a ,;,=90 when k is in PSU j of stratum 
O, Ayia j;,= 4 When k is not in stratum a at all, and 
Aaj = (M./[n, —1))a, otherwise. The w,,,, are 
constrained so that Dies Wea; X~ = Leev X;, for all a. 

Let S(a+) be the set of elements in stratum a (not 
PSU’s like S,), and S(aj) the set of elements in PSU / of 
stratum a. Under mild conditions we assume to hold, 
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ait cae Wr Ln (cj) /A,)X 
= (ny/ins D(X scape a ia w,X,/N, =O0,(N/n), 
h’ x,,=O,(N), 


5 Fn(aj)m 


and >. dice; Wn€n = Op(N/Vn). 

As a result, 
Ly CAL + bye CAL = Dae Wi (aj) ek — ». Wr &x 
=(n, /[n,- MIP2e.. w,e, /n,- Dp W, ep 
+ O,(N/n°'’), 


and v, = Vs,,[1+ Op(1/Vn)] when plim,, ,. (”vg7,/N)> 
0. 

The replicate weights defined in equation (12) do not 
require iteration even when the calibration weights are 
themselves produced that way. This is a great computation 
convenience. It not only saves computer time, it avoids the 
possibility that at iterative solution for the w, may exist 
while one for the replicate weights does not. 


6. Unit Nonresponse 


6.1 Quasi-randomization and Prediction Modeling 


In this section we explore handling unit (whole-element) 
nonresponse as an additional phase of Poisson sampling. 
That is the essence of a quasi-randomization model. Each 
element é in the original sample, now denoted F, is assumed 
to have a probability of response, p,. The probability of 
elements k and j jointly responding is p, p,, and whether 
element k would respond (given a vector of covariates) is 
independent of whether it is chosen for the original sample. 

It is often possible to construct a set of weights so that the 
calibration estimator is randomization consistent under the 
quasi-randomization model. We are interested here in a 
particular way of constructing those weights. To this end, 
we assume that the quasi-randomization model is correct. 
Each element has attached to it a row vector of auxiliary 
variables, x,, for which 7, = dy x j is known. Finally, 
each p, is assumed to have the form: 


P, =1/f(h, 9), (13) 


where is an unknown column vector, h, is a row vector 
with the same dimension as x,, and >; a,h, x, /N, where 
S now denotes the “subsample” of respondents, is invertible 
both for the realized population size, N, and in the 
probability limit. 

The function /(-) in equation (13) is assumed to be 
monotonic and twice differentiable. Its functional form is 
known, but the value of the governing parameter, 9, is not. 
When plugged into the calibration-weight equation, 
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w, =a,f(h,q), so that the calibration equation itself, 
>, wx, =T, holds, f(h,q) implicitly estimates the 
inverse of the element response probabilities. Unlike when 
calibration is used to correct for >, a,x differing from 7, 
due purely to sampling error, f(0) and /f’(0) do not need 
to be 1 nor does h,@ need to be zero. 

The most obvious choice for h, when postulating the 
response model in equation (13) is x, itself. In a common 
example of calibration weighting for nonresponse, the 
components of x, are indicator variables: x,, =1 when k is 
in group g and zero otherwise. When the groups are 
mutually exclusive, calibration weighting is the same thing 
as reweighting within post-stratification classes. See, for 
example, Sarndal, Swensson and Wretman (1992, page 
585). The prediction model usually underpinning calibration 
(the prefix “prediction” is needed to distinguish this model 
from the quasi-randomization one) assumes that every 
element k in group g, whether or not it would respond, has a 
common mean: £,(y,)=f,. The quasi-random response 
model is analogous: p,=1/o,. The two models are 
conceptually very different, however. 

When the groups are not mutually exclusive, raking is 
one method of determining calibration weights. There are 
others depending on the exact form of the assumed response 
function /(-). The prediction model remains linear, 
E.(y,) =X,B, while the response model that leads to 
raking, p, = exp{—x,}, does not. Berry, Flatt, and Pierce 
(1996) provides an example of using raking to adjust for 
nonresponse. 

In many applications of calibration weighting the 
components of x, are continuous or semi-continuous rather 
than dichotomous. In an annual crop survey, for example, 
let x,, be the quantity of corn harvested in the previous 
census of agriculture by farm k, x,, be the farm’s harvested 
wheat, x,, its harvested potatoes, and so forth. The annual 
crop survey has an assumed prediction model for farm k’s 
planted corn acres, y,,, of the form: y,, =x,B,, + €,. The 
subscript, 1, is corn-specific. There are other survey values 
of interest, like planted wheat acres, and potentially assumed 
prediction models for each. 

The quasi-random response model for the crop survey 
depends on assumptions about /(-) and h, in equation 
(13) with h, possibly equal to x,. Unlike the prediction 
model, the same assumed quasi-randomization model 
applies for all survey variables. 

Promising choices for /(-) are exp(-) and 1+ exp(-), 
the latter corresponding to a response probabilities being fit 
by a logistic function of h,@. It may also be reasonable to 
assume /,, i for 4 <1. In particular, setting ~=0 
means that the probability of farm k responding to the 
annual crop survey depends only on whether the farm had 


187 


corn, wheat, or potatoes on the previous census of 
agriculture rather than on how much of those crops it had. 

In the crop-survey example, the components of x, from 
the previous census were the best predictors available for 
the corresponding annual survey values before sampling. 
Whether farm & responds to the survey, however, is more 
likely a function of the farm’s current planted corn acres, if 
any, than on a predetermined proxy for that value. As a 
result, placing survey values in h, rather than corres- 
ponding census values is tempting. There is a theoretical 
problem with this procedure as we shall see. 

Given an /(-), the iterative method described in Section 
4 will often be able to uncover a row vector q such that 
T, =>, a, f(h,q)x,. When that happens, estimating 7, 
with ¢, car =DsM%)_, Where w, =a, f(h,q), will have 
good ‘properties under the linear prediction model: 
y, =x,B+¢€,, where E(e,|{x,,h,,/,|g ¢U}) =0 for all 
k €U,I, =1 tf element is both in the original sample and 
responds, 0 otherwise. 

Prediction-model unbiasedness is simply a result of the 
weights satisfying the calibration equation. Note, however, 
that if components of h, come from the survey rather than 
x,, the prediction-model assumption that E(¢,|h,)=0 
can be problematic. At the extreme, consider the case where 
one such component is y, itself: Usually, E(€,|y,) 1s not 
0. In the crop-survey example described earlier, y, can be 
the annual corn acres planted on farm k. Putting this value in 
h, makes the associated calibration estimator for corn 
prediction-model biased. 

When the prediction model is correct (treating 
E(e,|{x,,h,,7,|g <¢U})=0 as an integral part of the 
model), however, calibration weighting based on any choice 
of f(-) will produce estimators with good prediction- 
model-based properties. These estimators will also have 
good quasi-randomization properties when the response 
model in equation (13) is correct for that choice of f(-). In 
some sense, one model provides protection against the 
failure of the other. See Kott (1994). 

As noted, the prediction model is more likely to hold 
when h, =x,. Even then, sometimes the ¢, in the model 
in equation (2) satisfy E(é,|{x,|g<¢U})=0, but not 
E(e,|{x,/,|g «U})=0; that is to say, the sampling 
mechanism — including response - is not ignorable with 
respect to the prediction model. 

We can factor J, into J,,J,,, where /,, =1 if and only 
if k is in the original sample, and /,, =1 if and only if k 
would respond if sampled. The interested reader can 
confirm that calibration weighting provides some protection 
against bias if the prediction model in equation (2) holds 
when E(e,|{x,,h,,/,.|g €U})=0; that is when the 
response mechanism is ignorable with respect to the 
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prediction model but not necessarily the original sampling 
mechanism. 


6.2 Quasi-randomization Mean Squared Error 
Estimation 


Whether or not ¢, ca, can reasonably be called 
prediction-model unbiased has no effect on its quasi- 
randomization-based properties. Note that h,@ are h,q are 
scalar values not vectors. Since T, =>, a, f(h,q)x;, our 
assumptions and the mean value theorem (/(h,6)= 


f (hq) + £0, )(a,o — h,q)) reveal 
T,-> a, f (h,)x, = > a,[7'(0, hh, (q - 01x, 


keS keS 
=0,(N/Vn) 
for some scalar 0, between each h,q and h,@. From this 
we see that if >), a, f'(h,o) hx, /N is invertible both for 
the realized N and at the probability limit (recall that f is 
monotonic so f’ is never zero), then 


sie b ~ De a, f(b jq) /hjx; | 7 ) Sa, f (h;o)x; 
jc ieS 
i O,(1/Vn) 
I 1s a, f(b); hix; | be a Ds a, f (h,o)x, | 
+0,(1/n). 


The estimator ¢, ca, has an error of 


Tie Ad, all oF Sa, f(h.q), ea ye ae 


keS keU 
=D af yme - 2) er 
where 
ef 
Cp = Ve Xe (> ah (ho) p;h’,x, ) Diep (ho)p; hiy;; 
and p, =1/ f(h,). The e, are again unknown. They have 


been design so that Ya, f'(h,o)hie, = O,(N/Vn). 
Continuing: 


ty CAL aa 
Sia, f (hy d)e,- >, €, + »} a, tf (hq) — f(h,o)}e; 
keS keU keS 
Sie OO aes ee ae a URE 
+ O,(N/n) 
=>) a, f (hy o)e, — >) e +(q-9)'>, a, f(b, o)h,e, 
+ O,(N/n) 
=) a,f(h,o)e,- >) e+ O,(N/n). (14) 


Thus, ¢, ca, 1S quasi-randomization consistent under 
_ mild conditions whenever t = Ys a, f(h,)y, is. 

To estimate the quasi-randomization mean squared error 
of ¢, cay (ie., the estimator’s randomization mean squared 
error under the response model), we first note that the 
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probability that elements k and j,k # j, are both in the 
respondent subsample is Ty =; P,p;- Let T, Tt De, 
and recall that a,=1/n, and 1/p,=/f(h,o). From 
equation (14), we see that the quasi-randomization mean 
squared error of ¢, car 1S approximately 


El cisoty) | 
2 > >Y) (my- MH; Me! e;/%;) 


keU jeU 
=e. (1—n, Je; /m, 
keU 
+ ys a (My — TH, Me,/T, e,/m;). (15) 
keU jeU 
k#] 
If the original sample is Poisson, then v,, = 


di. (we a Were with 


1 
Ke Vi XE bp 29K, | > a, f'(hqyh’y,, (16) 
jeS jeS 

serves as both a reasonable estimator for prediction-model 

variance and quasi-randomization mean squared error under 

mild conditions, since w, ~1/n, and ne. A close 

relative of the non-intuitive sample residual in equation (16) 

can be found in Folsom and Singh (2000). See Kott (2004a) 

for a further discussion of v,, ina purely sampling context. 
For a general design, we can get close to a good 

variance/mean-squared-error estimator with 


2 2 
Voom = (w-wh 
keS 


+) »: [(t,; — %,1,)/ TM, mn, wr; )- ay) 
keS jeS 
k#j 

The right hand side of equation (17) estimates the nght hand 
side of equation (15) with 7» replacing e,. Note that 
a tS T, Jer / T, in equation (15) is estimated by 
Ys (w; —w,)r? rather than Ys w;(1—1,)7;, which would 
make v.,,, More consistent with ve. in equation (8). This 
substitution results in a variance estimator with good 
prediction-model-based properties when the ¢, are 
uncorrelated, and o, =x,C, for some ¢. It can be made 
even in the absence of nonresponse. 

When the actual sample is multistage, and the first stage 
selection probabilities are ignorably small, v,;, in equation 
(10) can be used as the variance/mean-squared-error 
estimator with 7, defined once more by equation (16). 

When /is linear, f'(0)=1, and the 7, in equation (16) 
are computed as if there were no nonresponse. The same 
holds true for the variance/mean-squared-error estimator 
Vsp7. Unfortunately, this f corresponds to an awkward- 
looking response-probability function: p, =1/h,9. Fuller, 
Loughin and Baker (1994) made these observations for the 
case where h, = c¢,X;. 
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The jackknife, v,, in equation (11) can be computed 
with these jackknife replicate weights: 


Wraj)= icuanle+| ee x i oy Wr (ayn 


meU mesS 


-] 
ze X Gand: the a, Ak (a;) f'(h, q)h, > (18) 


an obvious generalization of the jackknife replicate weights 
in equation (12). Again when /'(8)=1,v, can be 
computed as if there were no nonresponse. 


7. Coverage Modeling 


Folsom and Singh (2000) pointed out that the treatment 
of nonresponse through calibration weighting can also be 
used to adjust for undercoverage. In the context, the quasi- 
random phase as sampling occurs conceptually before the 
actual sample is drawn. The population associated with the 
sampling frame is assumed to be a Poisson sample from a 
hypothetical complete population for which the vector 7, 
must be known. The frame population becomes F’, while the 
hypothetical complete population is U. The probability that 
element k €U is in F is assumed to be modeled correctly 
by equation (13). If the first (from U to F) and second (from 
F to S) phases of sampling are independent, then all the 
theory developed for using calibration weighting to handle 
nonresponse carries over to handling undercoverage. 

It should be noted that coverage adjustment through 
calibration is a extension of the well-known practice of 
coverage adjustment through post-stratification often used 
with telephone surveys. As with the post-stratification 
special case, one needs quantities for the calibration targets 
for U that can be assumed to be free of error or to have very 
little mean squared error compared to the calibration 
estimators themselves. 

Folsom and Singh noted that overcoverage (duplication) 
or a combination of under and overcoverage can be handled 
with their methodology. The definition of p, in equation 
(13) becomes the expected number of times k is in the 
frame, which can now exceed | due to potential duplication. 

Folsom and Singh further suggested that /(-) have the 
flexible form: 
weley2 U(C —L)exp(x,o) + LU -C) 

(U —C) + (C —L)exp(x,4) 


where L>0,1<U<o, and L<C<U are predetermined 
constants. They call this the “General Exponential Model” 
or “GEM.” Observe that when C=1,U =o, and L=0, 
p,=1/f (x, 6) = exp(-x, 6). Similarly, when C=2, 
U=, and L=1, p, =[l+exp(x,)]'; that is to say, the 
probability of coverage (or response) is logistic. The values 


(19) 
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L and U serve as bounds on the calibration adjustment, 
f(), while C = f(0) is effectively its center. 

The authors made the calibration adjustment in GEM 
even more flexible by postulating three classes of sampling 
units, each with its own set of U, C, and L values. They 
proposed its use both for coverage-error and unit-non- 
response adjustment 


8. A Small Empirical Example 


Since the jackknife replicate weights expressed in 
equation (18) are new, it is prudent to investigate whether 
they actually work with real data. To this end, the author 
took the MU281 data from Sdérndal, Swensson and 
Wretman (1992) and replicated it 20 times (so NV = 5,620). 
Using stratified simple random sampling, 16 units were 
selected from each of the eight unequally-sized strata. The 
variable RMT85 served as y, and P75 as x, in x, = 
(i, x,). Each of the 128 sampled units was given a 
probability of being in the respondent subsample, S, which 
decreased with the size of x,; in particular, p, = 
exp(—0.35 x, /M.), where M, was the population mean 
of the x,. In 1,600 simulations, the size of the S ranged 
from 78 to 110, with an average of approximately 93.8. 

The total 7, was estimated two ways, with 7, ,, = 
Ys a (1+x,q)y, and with t, pxp=Ds a exp(x, gq”) y,, 
where q and q‘*” were respectively selected so that the 
calibration equation held. The former was a GREG 
estimator, while the latter was a generalized raking esti- 
mator. Both estimators were unbiased under the implied 
prediction model (y, =x,B+e,), but only ¢, .xp was 
randomization consistent under the correct response model. 
The GREG implicitly assumed p, =1/(o0) + ox, ) 
for unknown o and iNergs 

The small size of the sample relative to the population in 
each stratum allowed the ignoring of finite population 
correction in variance/mean-squared-error estimation (called 
“variance estimation” from now on). Variances were 
estimated using, i, the linearization estimator, v.;,, in 
equation (10) with 7, defined by equation (16), and, ii, the 
proposed jackknife, v,, in equation (11) with replicate 
weights defined by equation (18). To make the jackknife 
computations easier, the 16 samples in each stratum were 
randomly assigned to one of four clusters, so that only 32 
jackknife replicates had to be computed. 

For comparison purposes, a better version of the 
linearization variance estimator, labeled v.;,,.,, was also 
computed with 7 replaced by e4=y,- Xk 
(Lu f'(x,0)p;xx;)" Du F&O) P XV; where b and 
p, were known. In practice, e, is rarely known, but 
computing Vs75,) 1s useful here for comparison. 
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One should note that computations of 7, and e, were 
slightly different depending on whether the variance esti- 
mator for ¢, ,py OF for ¢, ~xp was of interest. For ¢, in, 
f(s; ) = JG; qg=L for ty EXP? reg. ts, - 
exp(x,q‘”’), and f"(x;o)=1/p,. 

Table 1 displays the empirical means (the mean over the 
1,600 simulations) of the two estimators for T, normalized 
so that 7, =100. Although both are close to unbiased, 
t, un IS significantly different from 100 at the 0.05 level; 
t, sxp 1S not. This is not surprising, since only the latter is 
based on the correct response model. 

The variance estimators and empirical mean squared 
errors of each estimator were normalized so that the 
empirical means of the respective Vgp(.)’s were 100. 
Neither Vp.) had an empirical mean_ significantly 
different from the empirical mean squared error (EMSE) of 
the associated estimator. This was a bit disappointing. It 
seems that although 7, ;;, hada significant empirical bias, 
this bias was such a small component of the estimator’s 
mean squared error, that the difference between its EMSE 
and the empirical mean of vg7,.) was not significant. 

The Vsro(2) were chosen as benchmarks for the table 
rather than the empirical mean squared errors because each 
Vsp2(e) had roughly half the empirical standard error of the 
corresponding EMSE (which itself was the average of 1,600 
squared differences) and correlated more strongly with the 
variance estimators. The t—values for this part of the table 
were also computed with respect to the vgp,.). 


The two linearization variance estimators had sur- 
prisingly large downward biases. Apparently, there was a 
tendency for unusually large w, ,, and w, xp to cause 
associated r, to be appreciably smaller than e, in absolute 
terms. The problems associated with unusually large w, 1 
and w, pxp seem to be more muted with the jackknives. 

To speed up the asymptotics of the linearization variance 
estimators (i.e., reduce the difference between 7, and e,), 
an ad-hoc adjustment of v,,, was computed by replacing 
each 7, with Acadjustea) =%/@,, Where wo, =1- 
X, (Xs a; f'(%; q) X; 8 af (x4) x,— 1 Ona 
Observe that under the prediction model with the ¢, 
uncorrelated and E(s{)=0;, E Giaikcw) ~o;. The near 
equality is exact when all the a,f'(x,q) and o,, 
respectively, are equal. 

The adjusted v,,, for both ¢, ,,, and 7, pyp remained 
biased downward, while the v ip were biased upward by a 
slightly smaller amount. Although these biases were 
significant, they were reasonably small (from 4.5 to 11.2%) 
and suggest that the variance estimators may have indeed 
been asymptotically unbiased as theoretically demonstrated 
in previous sections. 

Using vVgpz;.) aS an efficient proxy for EMSE, the 
empirical mean squared error of ¢, ;xp, Which incorporated 
the correct response model, was more than 13% larger than 
that of the 7, ;y~, which did not. One should not generalize 
broadly based on one data set involving only two calibration 
variables, however. See Crouse and Kott (2004) for a 
different set of results. 


Table 1 
Empirical Means of Estimators Based on 1,600 Simulations* 


Empirical mean (standard error) 
The Estimators for 7,,(7,, = 100) 


ty LIN 99.84 (0.06) 
ty EXP 100.04 (0.06) 
Variance Estimators for ¢,, pny (Egmp (Ysr2(e)) = 100) 
Ms) slo we ied (ay) 
VST2(adjusted) 95.53 (1.80) 
vy 104.69 (2.28) 
EMSE 9935° = 
Ver? 73.12 (1.54) 
YgT2(adjusted) 88.79 (1.98) 
Vy 107.00 (2.73) 
EMSE 101.21 — 
Other Statistics 

relvar (Vs72(e)[LIN}) OOS 
relvar (Vg72(e)fExP]) 0.059 — 


(Vg72(e)[LIN] fe VsT2(e)[EXP]) 


(Eemp (Yst2(e)fexp}) 


~ 0.1340 (0.010) 


t—value (two-sided significance) 


—2.79 (0.02) difference from 
0.58 (0.56) Ty 
— 19.96 (< 0.0001) difference from 
—6.09 (< 0.0001) Vgtxe) 
3.60 (0.0003) 
—0.18 (0.85) 
— 18.22 (< 0.0001) difference from 
—8.57 (< 0.0001) sa 
4.09 (< 0.0001) < 
0.33 (0.74) 
~13.87 (< 0.0001) 


* In four additional simulations, convergence was not reached in 10 iterations for ¢,, xp. They were excluded from the 


analysis. 
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Whether or not one is better off incorporating the correct 
response model in the calibration estimator, if one does so, 
then the variance estimators discussed in the previous 
section, perhaps with the linearization estimator adjusted as 
suggested in this section, appear to be serviceable. 

A second set of 1,600 simulations (not displayed) were 
done using the same population and stratified sampling 
design but with each sampled element given a 70% chance 
of being in the respondent sample (the average respondent 
sample size was roughly 89.8). In this set of simulations, 
both estimators for 7, are randomization consistent under 
the response model. Consequently, it is not surprising, that 
the empirical means of 7, ,;y and ¢, xp were virtually 
identical (within 0.01% of each other) as were their 
empirical mean squared errors (within 1% of each other). 
The empirical means of each pair of variance estimators 
(2.g., Valgp, for ¢, py and 7, xp) were likewise very 
close (within 1% of each other). The relative bias of the 
adjusted vs7, (compared to varg;,,,)) was —1.3% when 
estimating the variance of 7, ;,, and —2.2% when esti- 
mating the variance of ¢, ;yp. The relative biases of the 
unadjusted linearization variances were —9.0% and— 10.3%, 
respectively. The relative bias of both jackknives was 3.6%. 


9. Discussion 


9.1 Estimating a Response Model Explicitly 


When faced with unit nonresponse, many have attempted 
to estimate the element probabilities of response, p, = 
1/f(h,), directly. This method requires one to have 
information on h, for every element in the sample whether 
it responded to the survey or not, but h, need not have the 
same dimension as x,. The direct-adjustment method is 
generally not available for handling coverage errors. 

Fuller (2002) noted that there can be an extra term in the 
quasi-randomization mean squared error of 1¢, Greg = 
ds On Vy + (Toei ax) (Ls Cah x) Ds Onde Xps 
where S is the respondent subsample, a, = a,[1+ f(h,q)], 
and q is a consistent direct estimator for the quasi-random- 
ization model parameter, o. This does not imply that direct 
estimation of the response model based ona given f(-) and 
h, is less efficient than analogous calibration when h, has 
the same dimension of x,. See Kim (2004) for a suggestion 
otherwise. Nevertheless, the convenience of incorporating 
nonresponse adjustment into calibration is appealing when 
variance estimates need to be produced. 

A reasonable compromise is to choose the form of /(-) 
and h, by modeling the response behavior of the entire 
sample and then estimating the parameter of /(-) implicitly 
through calibration. This compromise also overcomes a 
striking weakness of using calibration weighting to adjust 


141 


for nonresponse (as well as for coverage errors). The 
choices for f(-) and h, are motivated primarily by plausi- 
bility and convenience and not by a statistical analysis of the 
data. 


9.2 Response Homogeneity Groups 


To control the magnitude of the weight adjustment due to 
nonresponse, Little (1986) recommended that one estimate 
q explicitly and then divide the sample into C mutually 
exclusive groups based on the sizes of the fitted /(h,q) 
values. One then computes the adjusted weight for each 
element k in group c as with post-stratification: w, jp; = 
(Leo Wz/Lsce) W,)W,, Where F..) is that part of the 
original sample in group c, S(c) is the subsample of F(c) that 
respond, and w, is the sampling weight assigned to element 
k after sampling but before quasi-random subsampling. This 
approach assumes that each element in a group has 
(roughly) the same probability of response, hence the term 
“response homogeneity group.” 

An alternative way of incorporating fitted /(h,q) 
values into the estimation based on methodology developed 
in the text follows. Divide the fitted values into P groups 
based in their sizes, where P is again the dimension of x,, 
and let d, be a row vector of indicator variables for the P 
cells. By setting each w, = a,[1+(T,-Lsa,x,)x 
(Xs adi x, “'d'.], one computes a set of weights for the 
respondent subsample that, unlike {w, ,,,} above, satisfies 
the calibration equation for the respondent sample. Because 
of the nature of d,, this linear method returns the same set 
of calibration weights as fitting w, =a, exp(d,f) would — 
if both produce a set of weights. Note that since calibration 
weights can be negative with the linear method, it may be 
able to find a set that the generalized raking method cannot. 
The linear method effectively scales the a, —value for every 
element in the same group by a fixed amount. Thus, it may 
not produce surprisingly small or surprisingly large weights 
when the dimension of x, is small compared to the sample 
size. 


9.3. Breaking Up Sample and Nonresponse 
Calibration 


In the previous section we noted that it is possible for 
components of h, in equation (13), the quasi-random 
response model, to be unknown before enumeration. When 
such an h, is used in calibration, it might no longer to 
reasonable to assert that the resulting 7, ca; 1s prediction- 
model unbiased. This is particularly troublesome when 
nonresponse is modest compared to the sample size. An 
intriguing idea is to calibrate in two phases. The first phase, 
sample calibration, adjusts for the difference between 7, 
and >), a,x,, and would not include any components in h, 
unavailable at the time of sampling. The second phase, 
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nonresponse calibration, adjusts for the difference between 
~rax, and >, a,x, and would include component 
variables only available after the respondent subsample is 
enumerated. 

A more thorough analysis of this idea must wait for 
another time. 


9.4 Work at NASS 


The National Agricultural Statistics Service (NASS) used 
variants of the Fuller et al. (1994) approach for handling 
undercoverage in the 2002 Census of Agriculture (see Fetter 
and Kott 2003) and for adjusting an agricultural economics 
survey with large nonresponse to match totals from more 
reliable surveys (see Crouse and Kott 2004). In this 
approach, /(-) has the form: 


L when x,0<L 
f(x,0) =4x,0 when L<x,o<U (20) 
UA Wien oe o), 


which truncates linear calibration at pre-specified values, L 
and U, to control the size of the weight adjustment. Note 
that when f(-)=U or L, f'(-)=0. Unlike the calibration 
adjustment in equation (19), /(-) in equation (20) is not 
twice differentiable at L or U. This does not cause a problem 
in practice. 

The agency’s original justification for calibration in these 
contexts was based on prediction-modeling. Equation (20) is 
simple to implement and appears to produce weights within 
an acceptable range more often than readily available 
alternatives. 

NASS is investigating the following questions: How 
sensitive is ¢, ca, tothe choice of f(-) in practice? Would 
a different choice for /(-) result in less bias, and if so, 
would the reduction in absolute bias translate into a lower 
mean squared error? What would be the effect of replacing 
some component of the vector of calibration variables with a 
better predictor of nonresponse/undercoverage? 
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The Importance of Modeling the Sampling Design in 
Multiple Imputation for Missing Data 


Jerome P. Reiter, Trivellore E. Raghunathan and Satkartar K. Kinney ' 


Abstract 


The theory of multiple imputation for missing data requires that imputations be made conditional on the sampling design. 
However, most standard software packages for performing model-based multiple imputation assume simple random 
samples, leading many practitioners not to account for complex sample design features, such as stratification and clustering, 
in their imputations. Theory predicts that analyses of such multiply-imputed data sets can yield biased estimates from the 
design-based perspective. In this article, we illustrate through simulation that (1) the bias can be severe when the design 
features are related to the survey variables of interest, and (11) the bias can be reduced by controlling for the design features 
in the imputation models. The simulations also illustrate that conditioning on irrelevant design features in the imputation 
models can yield conservative inferences, provided that the models include other relevant predictors. These results suggest a 
prescription for imputers: the safest course of action is to include design variables in the specification of imputation models. 
Using real data, we demonstrate a simple approach for incorporating complex design features that can be used with some of 
the standard software packages for creating multiple imputations. 


Key Words: Complex sampling design; Multiple imputation; Nonresponse; Surveys. 


1. Introduction 


Typically in large surveys, less than 100% of the sampled 
units respond fully to the survey. Some units do not respond 
at all, and others respond only to certain items. One 
approach to handle such nonresponse is multiple imputation 
of missing data (Rubin 1987). It has been used in, for 
example, the Fatality Analysis Reporting System (Heitjan 
and Little 1991), the Consumer Expenditures Survey 
(Raghunathan and Paulin 1998), the National Health and 
Nutrition Examination Survey (Schafer, Ezzati-Rice, 
Johnson, Khare, Little and Rubin 1998), the Survey of 
Consumer Finances (Kennickell 1998) and the National 
Health Interview Survey (Schenker, Raghunathan, Chiu, 
Makuc, Zhang and Cohen 2005). Multiple imputation also 
has been suggested to protect confidentiality of public- 
release data (Rubin 1993; Little 1993; Raghunathan, Reiter 
and Rubin 2003; Reiter 2003, 2004, 2005). See Rubin 
(1996) and Barnard and Meng (1999) for a review of other 
applications. 

Multiple imputation, in theory, conditions on the 
sampling design when deriving methods for obtaining infer- 
ences from multiply-imputed datasets (Rubin 1987). How- 
ever, imputers seldom account for complex sampling design 
features, such as stratification and clustering, when using 
available software packages to construct imputation models. 
They instead use multivariate normal or general location 
models (e.g., the software NORM written by Joe Schafer), 
or use sequential regression models (Raghunathan, 


Lepkowshi, van Hoewyk and Solenberger 2001). These 
methods can be modified to incorporate design features, but 
this is infrequently done. 

This paper has two objectives. First, we illustrate the bias 
that can arise when imputers fail to account for complex 
design features in imputation models. To do so, we simulate 
multiple imputation in two-stage, stratified-cluster samples. 
The simulations indicate these biases can be severe, even 
when using design-based estimators in multiply-imputed 
data sets with moderate amounts of missing data. Second, 
we suggest two simple approaches to account for design 
features in imputation models. The first approach, which is 
relatively easy to implement, includes dummy variables for 
stratum or cluster effects in the imputation models. The 
second approach, which is computationally more complex 
than the first, uses hierarchical models where (1) the effects 
of clustering are incorporated using random effects, and (11) 
the effects of stratification are incorporated using fixed 
effects. The simulations show that accounting for the design 
in these ways can reduce the bias. They also illustrate that 
controlling for design features that are unrelated to the 
survey variables can result in inefficient, but conservative, 
inferences relative to those from models that do not 
condition on such features, provided that the models include 
the predictors required to make the missing at random 
assumption (Rubin 1976) plausible. We demonstrate the 
first approach to incorporating the design features by 
imputing missing data from the National Health and 
Nutrition Examination Survey using a sequential regression 
approach. 


1. Jerome P. Reiter and Satkartar K. Kinney, Institute of Statistics and Decision Sciences, Box 90251, Duke University, Durham, NC 27708, U.S.A.; 
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2. Inferences from Multiply-Imputed Data Sets 


To describe construction of and inferences from 
multiply-imputed data sets, we use the notation of Rubin 
(1987). For a finite population of size N, let J, =1 if unit; 
is selected in the original survey, and J, =0 otherwise, 
where f= 12) Nose dl = (yeaa tt) Deli Deu ie 
size of the sample obtained using a complex design. To 
simplify notation, assume only one variable in the survey is 
subject to nonresponse. Let R, =1 if unit 7 responds to the 
original survey, and &,=0 otherwise. Let R= 
(R,,...,Ry).The notation can be extended to handle 
multivariate item nonresponse, but such complication is not 
necessary for our purposes. 

Let Ybe the Nx p matrix of survey data for all units in 
the population. Let Y,,, =(Yous» Ymis) be the mx p matrix 
of survey data for units with J, =1; ¥,,, is the portion of 
Y,,. that is observed, and Y,,;, is the portion of Y,,, that is 
missing due to nonresponse. Let Z be the N xd matrix of 
design variables for all NV units in the population, e.g., stra- 
tum or cluster indicators or size measures. We assume that 
such design information is known at least approximately, 
for example from census records or the sampling frames. 
Values for Y_,,, are usually constructed from draws from 
some approximation to the Bayesian posterior predictive 
distribution of (Y,;,|Z,¥,,./,R). These draws are 
repeated independently /=1,...,M times to obtain M 
completed data sets, D® =(Z, 1a: eke j baal a 

From these multiply-imputed data sets, some user of the 
data seeks inferences about some estimand O=QO(Z,Y). 
For example, Q could be a population mean or a population 
regression coefficient. In each imputed data set D“, the 
analyst estimates QO with some estimator g and the variance 
of g with some estimator u. We assume that the analyst 
specifies g and wu by acting as if each D“ was in fact 
collected data from a random sample of (Z,Y) based on 
the original sampling design J, i.e., g and u are complete- 
data estimators. 

For /=1,...,M, let g and u be respectively the 
values of g and u in data set D®. Under assumptions 
described in (Rubin 1987), the analyst can obtain valid 
inferences for scalar QO by combining the g‘? and u. 
Specifically, the following quantities are needed for 
inferences: 


is 


M 

Iu = 2,9 /M (1) 
L=1 
= l 2 

by = @° - Fy) (MM -1) (2) 
[=1 
M 

TE NINE (3) 


=] 
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The analyst then can use q,, to estimate Q and 
Ty =(+5)) by + Uy to estimate the variance of Gj, 
When 7 and M are large, inferences for scalar QO can be 
based on normal distributions, so that a (l—a)% 
confidence interval for QO is qy+z(a/ De » FOL 
moderate M, inferences can be based on ¢—distributions with 
degrees of freedom v,, =(M-IJ)(0+ (nee where 
A, =e, \b alte. so that a (l—a)% confidence 
interval for 0 is Gy tty(a/ 2). Tea . Refinements of these 
basic combining rules have been proposed by several 
authors, including Li, Raghunathan and Rubin (1991a), Li, 
Meng and Rubin (1991b), Raghunathan and Siscovick 
(1996), and Barnard and Rubin (1999). 


3. Illustrative Simulations 


In this section, we use simulations to illustrate the 
biases/inefficiencies associated with incorporating design 
features in imputation models. We simulate three target 
populations of N =100,000 units that are stratified and 
clustered within strata. In the first population, Y depends on 
both stratum and cluster effects. In the second population, Y 
depends on strata but not on cluster effects. In the third 
population, Y is unrelated to the stratum and cluster indi- 
cators. The first population is used to demonstrate the 
importance of including all relevant design variables, and 
the second and third populations are used to examine the 
effect of including irrelevant design variables. The 
simulated populations are stylized to illustrate the 
importance of modeling the survey design; hence, the 
magnitudes of biases/inefficiencies may not be 
generalizable to other settings. 

Each population is divided into five equally-sized strata 
comprised of N,=200 clusters, for h=1,...,5. Each 
cluster c in stratum / is comprised of N,. units. In each 
stratum, ten clusters have N,. = 300, twenty clusters have 
N,. = 200, sixty clusters have N,.=100, sixty clusters 
have N,.=75, and fifty clusters have N,.=50. Cluster 
sizes are varied to magnify design effects when taking 
multi-stage cluster samples. For each target population, 
there are two survey variables, X and Y. In all three 
populations, for simplicity we generate each X,,,,, where j 
indexes a unit within stratum and cluster fic, from 
AG NO; 10°). To generate Y, we use different methods 
for each population, as shall be described in subsequent 
sections. 

We randomly sample units from each population using 
multi-stage cluster sampling. First, we take a simple random 
sample of n, = 40 clusters from stratum 1,7, =20 clusters 
from stratum 2,7, =30 clusters from stratum 3,7, =10 
clusters from stratum 4, and n; =15 clusters from stratum 
5. The cluster sample sizes differ across strata to magnify 
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design effects relative to equal sampling. We then take a 
simple random sample of twenty units from each sampled 
cluster. Hence, there are 2,300 units with /,,., =1. 

The estimands of interest in each population are O=Y, 
the population mean of Y, and the coefficients for the 
population regression of Y on X. The complete-data esti- 
mator of Y is the usual, unbiased design-based estimator, 


1 5s 200 fi 
q pas ie ceh in 


~ 100,000 ny 


where y,. = N,,.¥),- 18 the estimated total in cluster hc. The 
complete-data estimator of the variance of ¢ 1s, 


5 2 aed oP 
Die 00 hr /n, 
s 200 2 DO 
aia aa Punk ma (1-2 Jee 
h 


he 


Uu — 2 ae 
100,000 


where s; is the sample variance of the },. and s;. is the 
sample variance of Y within cluster hc. The estimators of the 
coefficients in the regression of Y on X are the usual 
approximately unbiased, design-based estimators, which are 
computed using the “survey” routines (Lumley 2004) in the 
software package R. These routines estimate variances using 
Taylor series linearizations. These estimators are used for all 
multiply-imputed data sets in all simulations. 

For each sample, we let_X be fully observed, and let Y be 
missing for about 30% of the sampled units. 

Each unit’s binary response variable, R 
from a Bernoulli distribution: 


hej> 1S drawn 


exp(—0.847 —0.LX,,.) 
Pr(R,,; = 1) = ———_—_——_— (4) 
= 1+ exp(—0.847 —0.LX,,;) 


Here, R,., =1 means that the unit’s value of Y is missing. 
Equation 4 implies that Y_,,, 1s missing at random (Rubin 
1976). We can ignore the missing data mechanism provided 
that imputations for missing data are conditional on X. We 
purposefully do not allow missingness to depend on stratum 
or cluster membership to illustrate that bias can arise from 
failing to account for the survey design even when the 
ignorable missing data mechanism does not depend on the 
sampling design. Of course, if the sampling design is related 
to missingness, as it is in many real datasets, one must 
condition on the sampling design to make the missing data 
mechanism ignorable. 

We examine three strategies to impute Y,,, that make 
different use of the design information. These strategies are 
summarized in Table 1. The first strategy, labeled SRS, 
completely disregards the sampling design. The second 
strategy, FX, incorporates the stratification and the 
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clustering by using fixed effects for each cluster within 
stratum. The third strategy, HM, uses normal random effects 
models that incorporate the stratification and clustering. For 
SRS, one model is fit to the entire data set. For FX and HM, 
models are fit separately in each stratum. All three strategies 
regress on X because it is part of the missing data 
mechanism; not conditioning on X would violate ignorabi- 
lity and cause bias. 


Table 1 
Imputation Strategies 
Imputation model for missing Y,,; 
SRS N(Bq + BLXjgjs ”) 
FX N(Bon + BinX hej + Phe? 57) 
HM Non + Bir X het + ner Fh) One ~ NO, 2”) 


All imputations are draws from the appropriate Bayesian 
posterior predictive distributions. First, we draw parameters 
of the imputation models from their posterior distributions 
given the components of the observed data, (Z,X, 
Y.4,./,R), that are included in the models. Second, we 
draw values of the missing data from the distributions given 
in Table 1. Diffuse priors are used for all parameters. For 
strategy HM, we draw values of the parameters using a 
Gibbs sampler (Gelfand and Smith 1990). We run the 
sampler for a burn-in period to get approximate conver- 
gence, then we use every tenth draw for imputations. 
Finally, we use M =5 independently drawn imputations in 
each data set for each strategy. 


3.1 Simulation A: Illustration of Disregarding 
Relevant Design Features 


In this simulation, we generate a population in which the 
distributions of Y differ across strata and clusters. We call 
this “Population 1”. Specifically, for unit 7 in stratum / and 
cluster c, we construct the population value of Y,,, from 

i 


nei = 10 Xj + Bon + Onct Eng (5) 
where f,, 1s a scalar constant for stratum h, the @,. 1s a 
scalar constant for cluster hc, and €,,,; is a random error 
term drawn from N(0, 200°). The values of the stratum 
effects are [,,.=500,,B,, =—250, 6), = 9,85, =250,, and 

05 = —500. The values of the o,, are obtained by drawing 
five sets of N, =200 values from independent N(0, 70°). 
The stratum and cluster effects are widely dispersed to 
magnify design effects relative to simple random sampling, 
which in turn magnifies the effects of disregarding the 
design in imputations. We then sample from this population 
using the stratified cluster sampling scheme outlined 
previously. We create the missing data indicator R using 
equation 4. 
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Table 2 shows the results of 1,000 replications of the 
three imputation strategies outlined in Table 1. The 
additional row labeled “Complete data” shows the results 
using the data for all sampled units, i.e., assuming no units 
with J,,; =1 have R,,,; =0. The column labeled “95% CI 
cov.” contains the percentage of the 1,000 simulated 
confidence intervals that contain the population parameter. 
The column labeled “Pt. Est.” contains the averages of the 
1,000 point estimates of Q. The column labeled “Var” 
contains the variances of the 1,000 point estimates of O. The 
column labeled “Est. Var” contains the averages across the 
1,000 replications of the estimated variances of the point 
estimates. The columns labeled “Var(Est.Var)” and 
“MSE(Est.Var)” give the variance and mean squared error 
of the 1,000 estimated variances. 

Imputations based on method SRS lead to severely 
biased estimates and very poor confidence interval coverage 
in this population. These problems exist even though there 
is not much missing information and despite the fact that we 
use design-unbiased estimators for inferences. Both FX and 
HM have point estimates that approximately match the 
complete-data point estimates, and both have coverage rates 
that approximately match the rates for the complete data 
inferences. FX and HM have similar profiles because the 
fixed effect models and the hierarchical models produce 
similar estimates of the parameters in equation 5. 

When estimating the population mean, the variance 
associated with FX or HM is only slightly larger than the 
variance associated with the complete-data estimator. This 
is because of the large cluster effects, which makes the 
within-imputation variance a dominant factor relative to the 
between-imputation variance. That is, the fraction of 
missing information due to missing data is relatively small 
when compared to the effect of clustering. 


3.2 Simulation B: Illustration of including irrelevant 
predictors 


Modeling the design features is essential when the 
features are related to the survey variables of interest. How 
does modeling irrelevant design features affect inferences? 
In this section, we present the results of two simulation 
studies that explore this question. 

First, we generate “Population 2” in which the distribu- 
tion of Y differs across strata but does not depend on the 
clusters. To do so, we use the same generation method as in 
Equation 5, setting the @,, equal to zero. The eé,,, are 
drawn from N(0,100°). We sample from Population 2 and 
generate missing data using the schemes outlined 
previously. The results for 1,000 replications are displayed 
in Table 3. 

SRS continues to have severe bias and poor confidence 
interval coverage because it ignores the stratification. For 
FX and HM, the averages of their point estimates are within 
simulation error of the average of the point estimates for the 
complete data. Additionally, their confidence interval 
coverage rates approximately match the coverage rate for 
the complete-data intervals. This indicates that FX and HM 
are reasonable for these populations, even though the 
relevant cluster features are included in their imputation 
models. 

We next generate “Population” 3 in which the distribu- 
tion of Yis independent of the strata and cluster membership 
indicators. Specifically, to generate Y, we subtract the Bo, 
from the values of Y generated in Population 2. We then 
sample from Population 3 using the stratified cluster 
sampling scheme and create missing data using the methods 
outlined previously. The results for 1,000 replications are 
displayed in Table 4. 


Table 2 
Performance of Imputation Procedures when the Design Features are Related to the Survey Variable of Interest. 
The Population Mean Equals 3.2 and the Population Regression Coefficients Equal 3.0 and 10.1 


Method 95% CI cov. PE Est. 
Complete data 94.2 20) 
SRS 38.0 45.8 
Mees enlex. 94.8 2.4 
HM 94.5 oRe: 
Complete data 93.0 2.4 
SRS 39.5 46.8 
fntercept "0 EX 94.5 2.8 
HM 93:9 pied 
Complete data 93.3 10.1 
See SRS 64.8 7.6 
P FX 94.5 10.1 
HM 95.7 10.1 
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Var Est. Var Var(Est. Var) MSE (Est. Var) 
544.91 SPA elt! 31,626.19 31,936.07 
Sy a 8) 360.74 1092797 13,013.35 
554.09 579.92 37,474.82 38,141.70 
551.02 553.16 34,056.39 34,060.99 
529.51 499.73 18,543.13 19,430.21 
340.09 365.50 9351315 9,996.99 
539.19 551.68 21,529.16 21,685.33 
536.82 524.82 19,256.24 19,400.11 

1.24 1a 0.14 0.15 

2.10 2.20 0.55 0.56 

1.45 1.44 0.18 0.18 

153 1.65 0.29 0.30 
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Table 3 
Performance of Imputation Procedures when the Population has Stratum Effects but no Cluster Effects. 
The Population Mean Equals 0.34 and the Population Regression Coefficients Equal 0.14 and 10.13 


Method 95% CI cov. Pt. Est. Var Est. Var Var(Est. Var) MSE (Est. Var) 
Complete data 93.6 0.37 468.97 461.88 29,301.77 29,352.04 
vee YP SRS 31.1 42.90 259.46 303.46 10,228.40 12,164.74 
ie FX 93.7 0.32 473.86 474.21 30,408.95 30,409.07 
HM 93.4 0.34 476.03 465.53 29,406.61 29,516.85 
Complete data 93.0 0.72 451.46 432.74 14,955.20 15,305.73 
SRS 31.5 43.10 Dy SOW) 311.36 8,134.04 9,440.57 
Intercept FX 93.2 0.66 456.08 444.88 15,539.21 15,664.64 
HM 92.3 0.68 457.48 436.25 14,941.00 15,391.75 
Complete data 93.1 10.09 0.99 0.91 0.09 0.10 
ed SRS 59.0 7.72 1.67 iit 0.35 0.36 
. FX 93.4 10.10 1.03 0.98 0.10 0.10 
HM 93.3 10.10 1.03 0.96 0.10 0.10 

Table 4 


Performance of Imputation Procedures when the Design Variables are Completely Unrelated to the Survey Variable of Interest. 
The Population Mean Equals 0.34 and the Population Regression Coefficients Equal 0.14 and 10.04 


Method 95% CI cov. Pt. Est, Var Est. Var Var(Est. Var) MSE (Est. Var) 
Complete data 94.7 0.35 14.61 14.73 32.65 32.66 
Rama SRS 95.7 0.12 16.45 19.22 40.65 48.31 
a FX 97.8 0.40 19.64 28.29 97.66 172.38 
HM 95.1 0.26 LS77 19.16 47.29 47.44 
Complete data 93.7 0.12 (ae 7.20 531 53) 
SRS 96.8 —0.10 8.97 tl72 13.59 21.10 
Intercept FX 98.6 0.17 12.23 20.62 39.84 110.24 
HM 96.2 0.03 10.45 11.61 15.09 16.45 
Complete data 94.5 10.04 0.07 0.07 0.001 0.001 
eens SRS 96.4 10.07 0.10 0.13 0.002 0.003 
P FX 96.4 10.04 0.12 0.15 0.003 0.004 
HM 95.2 10.05 0.11 0.12 0.002 0.002 


SRS finally produces point estimates whose averages are 
within simulation error of the complete data average point 
estimate. This is because the imputations in SRS reflect the 
population structure reasonably well. This suggests that 
disregarding the design in imputation models may provide 
acceptable inferences when the design variables are only 
weakly correlated with the survey outcomes. As in the 
previous simulations, FX and HM continue to have average 
point estimates within simulation error of the complete-data 
average point estimate. When comparing the three impu- 
tation strategies, we see that FX and HM are inefficient 
relative to SRS. This is because the imputation models for 
FX and HM estimate parameters that equal approximately 
zero in the population, whereas SRS sets them equal to zero. 
HM has smaller variance than FX does, because the 
hierarchical imputation model smoothes the estimated 
cluster effects towards zero. 

For FX, the percentage of confidence intervals that cover 
QO is larger than the percentages for the complete-data 
intervals and HM intervals. This is because the estimated 
variance for FX tends to be larger than its actual variance. 


This apparent upward bias in 7,, also exists for SRS, 
resulting in a larger coverage percentage than those for the 
complete-data and HM. 


4. Real Data Example 


We next examine the effect of accounting for stratifi- 
cation and clustering when imputing missing data in a 
genuine dataset. The data are taken from the public use file 
for the 1999-2002 National Health and Nutrition 
Examination Surveys. Individuals are grouped in 56 clusters 
divided among 28 strata. Many variables have 5% to 10% 
missing data. 

We imputed missing data using two strategies: one 
ignoring design variables (like SRS) and one incorporating 
the design variables using fixed effects for cluster indicators 
(like FX). In the imputation model, we included 27 dummy 
variables to represent 28 strata and one dummy variable 
within-each stratum to represent the two clusters nested 
within each stratum. That is, a total of 55 dummy variables 
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were included as predictors. We used a stepwise variable 
selection procedure to identify statistically significant 
interactions between these dummy variables and survey 
variables, and we included these interactions as predictors in 
the imputation model as well. The values were imputed 
using the sequential regression approach implemented in the 
software package IVEWARE (www. isr.umich.edu/sre/smp/ 
ive). We generate M= 10 data sets for each strategy. 

We consider three estimands. The first is the population 
percentage of people who have ever had their blood 
cholesterol level checked (BPQ060). This variable has about 
15% missing values. The second and third are the popu- 
lation regression coefficients in a logistic regression of 
BPQ060 on family poverty income ratio UNDFMPIR), a 
continuous variable that has about 12% missing values. 
These estimands are estimated using design-based methods 
computed with the “survey” routines in the software 
package R. 

Table 5 displays the results for both imputation 
strategies. The two sets of estimates for all analyses are very 
similar. In this case, incorporating the design variables into 
the imputation model hardly impacts the results. This is due 
in part to the small fractions of missing information and the 
relative unimportance of stratum and cluster effects. How- 
ever, there is minimal penalty for including the design 
features in the imputation model. In light of the results of 
the simulations in section 3, we would incorporate the 
design features in this imputation model. 


Table 5 
Comparison of Real Data Results when Design Features 
are Included in Imputation Model and when 
Design Features are Ignored 


Pt. Est. S.E, 95% CI 

Mean BPQ060 

design 0.319 0.010 (0.299, 0.339) 

no design 0.319 0.011 (0.296, 0.341) 
Intercept: Logistic Regression 

design 0.362 0.054 (0.256, 0.467) 

no design 0.352 0.052 (0.251, 0.454) 
Slope: Logistic Regression 

design —0.409 0.020 (0.449, —0.369) 

no design —0.407 0.019 (—0.444, —0.371) 


5. Concluding Remarks 


The simulation studies, though limited, suggest dis- 
regarding the sampling design in multiple imputation can be 
a risky practice. When the design variables are related to the 
survey variables, as in our Simulation A, failing to include 
the design variables can lead to severe bias. On the other 
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hand, including irrelevant design variables, as in our 
Simulation B and the NHANES example, leads at worst to 
inefficient and conservative inferences when the imputation 
models are otherwise properly specified. 

Including dummy variables for cluster effects greatly 
reduced the bias relative to disregarding the design 
completely. However, blindly including dummy variables is 
not an automatic solution. When the regression slopes or 
variances differ across clusters, using FX or HM may result 
in biased estimates, since important design features are 
disregarded. Imputers suspecting such relationships should 
include appropriate interactions with the dummy variables 
for the design features, as we did in the NHANES example. 
In some surveys the design may be so complicated that it is 
impractical to include dummy variables for every cluster. In 
these cases, imputers can simplify the model for the design 
variables, for example collapsing cluster categories or 
including proxy variables (e.g., cluster size) that are related 
to the outcome of interest. 

The simulations suggest that there can be payoffs to 
using hierarchical models for imputation of missing data 
relative to using fixed effects models, particularly when 
cluster effects are similar. However, hierarchical models are 
more difficult to fit than fixed effect models. For example, it 
is daunting to fit hierarchical models in complex designs 
when data are missing for several continuous and 
categorical variables. It may be possible to fit sequential 
hierarchical models in a spirit similar to the sequential 
regression imputations of Raghunathan ef a/. (2001). This is 
an area for future research. A further disadvantage of 
hierarchical models is that they are easier to mis-specify 
than fixed effects models. For example, if the cluster effects 
follow a non-normal distribution, the hierarchical normal 
model used in this paper could provide implausible 
imputations. 

With multiple imputation, the key to success is 
specifying an imputation model that reasonably describes 
the conditional distribution of the missing values given the 
observed values. Design features frequently are related to 
survey variables, so that including them in the imputation 
models reduces the risks of model mis-specification. We 
believe that in many cases the potential biases resulting 
from excluding important design variables, or other 
variables related to the missing data mechanism, outweigh 
the potential inefficiencies from estimating small coeffi- 
cients. This reinforces the general advice provided by many 
on multiple imputation: include all variables that are related 
to the missing data in imputation models to make the 
missing data mechanism ignorable (e.g., Meng 1994; Little 
and Raghunathan 1997; Schafer 1997, and Collins, Schafer 
and Kam 2001). 
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Bernoulli Bootstrap for Stratified Multistage Sampling 


Fumio Funaoka, Hiroshi Saigo, Randy R. Sitter and Tsutom Toida ' 


Abstract 


In this article, we propose a Bernoulli-type bootstrap method that can easily handle multi-stage stratified designs where 
sampling fractions are large, provided simple random sampling without replacement is used at each stage. The method 
provides a set of replicate weights which yield consistent variance estimates for both smooth and non-smooth estimators. 
The method’s strength is in its simplicity. It can easily be extended to any number of stages without much complication. The 
main idea is to either keep or replace a sampling unit at each stage with preassigned probabilities, to construct the bootstrap 
sample. A limited simulation study is presented to evaluate performance and, as an illustration, we apply the method to the 


1997 Japanese National Survey of Prices. 


Key Words: Complex survey; Linearization; Quantiles; Resampling; Stratification. 


1. Introduction 


Many large scale surveys are conducted using a stratified 
multi-stage sampling design. Variance estimation in this 
type of design can be analytically involved or even 
impossible. In addition, for publicly released data sets the 
specific forms of estimators the end-user may wish to obtain 
variance estimates for are unknown. As a result, resampling 
methods are often carried out to obtain a set of replicate 
weights that can be supplied with the data set and used for 
the purpose of variance estimation for a broad class of 
possible estimators. The bootstrap is particularly useful 
since it can handle both smooth and nonsmooth sample 
statistics under multistage designs. A concise summary of 
several bootstrap methods for finite population sampling is 
found in Shao and Tu (1995, pages 232-282) (see also, 
Gross 1980; Bickel and Freedman 1984; McCarthy and 
Snowden 1985; Rao and Wu 1988; Kovar, Rao and Wu 
1988; Sitter 1992a, b; Booth, Butler and Hall 1994; Shao 
and Sitter 1996). 

If the first-stage sampling fraction is small, there are 
various bootstrap methods available that treat the first-stage 
sampling as having been with-replacement for the purposes 
of variance estimation. In the case where the first-stage 
sampling fraction is not negligible, there are fewer results 
available. For bootstrapping in two-stage sampling with 
simple random sampling (SRS) at each stage see Sitter 
(1992a, 1992b) and with unequal probabilities Rao and Wu 
(1988). However, if the first-stage sampling fractions are not 
negligible no simple bootstrap procedure is available for 
three or more stages of sampling. In this paper, we propose 
a new bootstrap method which easily accommodates such 
cases when the sampling is simple random sampling (SRS) 


at each stage. We call it a Bernoulli bootstrap (BBE) 
because of its resemblance to Bernoulli sampling. The 
National Survey of Prices (NSP) in Japan is used for 
illustration. 

The paper is organized as follows. Section 2 introduces 
notation for three-stage stratified sampling. Section 3 
describes two types of BBE. Section 4 investigates 
properties of the methods via simulation. Section 5 
describes the sampling design of the 1997 NSP and 
illustrates the use of BBE on the NSP data. Concluding 
remarks are made in section 6. 


2. Stratified Three-Stage Sampling 


In stratified random sampling, the finite population, 
consisting of N primary sampling units (PSU’s), 1s 
partitioned into H nonoverlapping strata of N,, N,,..., Ny 
PSU’s, respectively; thus, 77, N, =N. A simple random 
sample without replacement (SRSWOR) of PSU’s is taken 
independently from each stratum. The sample sizes within 
each stratum are denoted by 7,,7,,...,”,,, and the total 
PSU sample size is n=j/,n,. At the second stage, a 
sample of m,, secondary sampling units (SSU’s) are 
selected from PSU i of size M,, within stratum h by 
SRSWOR. At the third stage, a sample of /,,, ultimate 
sampling units (USU’s) are selected from SSU ij of size 
L,; within stratum A by SRSWOR. A_ vector of 
measurements of some unit characteristics is represented as 
Y nik Ue Te ae where the subscripts hijk 
refer to the stratum label, PSU label, SSU label and USU 
label, respectively. The population parameter of interest 
8 =0(S), where S={y pg A=, 2.25 H51=1,2,...,N,; 
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Jal... My k =1,..., Lyyt; 
0= 4(s), where s= a pat, 2. 
j=i,...,m,i Keds } evtkhe eoghlsaon total vector is 


is usually estimated by 
gr lois Thy 


bn 

fenoeed: VSO tes yy" in this case, its unbiased estimate 
is 

taf H ny, 

Y=>% => (N,/m,)> Yue 

h=l h=l i=l 
where Yui = 4G; yi lap and i vs, = (Lay | nij) 
ae 1 Ynix- This may be written as Y= Yoage WiiY nic 


where w,,, =(N, /7,)(M jj / My; (Lp [Tn )- 
For t=1, an unbiased estimate of Var(Y) is v(Y) = 
Ss WY, ), where 


5 Ni, 7 (L- Sn, 


Ny, M2 1 cy, 2 
v0.) = ni ( Soni )Sni 


Ny ie) i=l My; 


n, Mp; =. 2 
eo M ii Ss L,( Snip) Shi 


My, j=l & j=l Li 


hij 
. y -1 BN reepnig 
with = Y,, =n, mY, rie eit pk Gr ih = Li dk Vnijke> 
_ SN oS) 
Fin =! Ni Son = My! Mais Soni = ae iii Tes, =r; -%)/ 


(Casa OO Sy OM etn Ee ee 
(Vriik Sy Ml, —1) (Sarndal, Swensson and Wretman 


1992, pages 148-149). 


3. Proposed Bernoulli Bootstrap 


To handle the multi-stage aspect of the sampling within 
stratum, we propose a multi-stage bootstrap. To simplify 
ideas, we first introduce a simple version that has some 
limitations in applicability. We will then subsequently 
describe a more general form that avoids these difficulties. 


A Short Cut BBE 
Step I. For each sample PSU, Ai, within stratum 
h,h=1,...,H, we: (a) keep it in the bootstrap 
sample with probability 
F % ad a Sin) : 
felis 
or (b) replace it with one selected randomly 


from the n, PSU’s. If (a) is the case, go to Step 
Il. 


For each SSU hij in PSU hi of stratum h kept 
at Step I, we: (c) keep it in a bootstrap sample 
with probability 


(3.1) 


h — 


Step II. 


“Ae Wee CF aa), 
, (- m,)) 


Fini = (3.2) 
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or (d) replace it with one selected randomly 
from the m,, SSU’s in PSU hi of stratum A. If 
(c) is the case, go to Step III. 


For each USU hijk in SSU Aij in PSU hi of 
stratum h, we: (e) keep it in the bootstrap 
sample with probability 

An Sani § C= Sani) 
Pi, Di Cr pes 


Step IIL. 


(3.3) 


Lae ]-—+* 


or (f) replace it with one randomly selected from 
the. 7, USU’s im SSU hy in PSUs in OL 


hij 
stratum h. 


If we let Ki, denote the number of times unit hijk 
appears in the bootstrap resample, then the bootstrap 
estimate of the total is Y = = Dik Wri Viniies where Wij = 
Ke hij, Wai and the bootstrap estimate of V (6) iS v,(0) = 
Ve (6° ), Where 6° = =o(Y ) and V, represents the variance 
under the resampling procedure. Typically, the bootstrap 
estimate of variance is obtained by Monte Carlo simulation. 
That is, repeat Steps I-III a large number of times, B, to get 
6,,...,6, and use 


B 
v3 ()= 2 (0, — 9)" /B, 


where 8.) = > _,6'/B. In most cases one can replace 0.) 
by 6. This allows the survey methodologist to create a set 
of replicate weights Whi for each bootstrap resample and 
release these with the data released to the public. 

Obviously, the short cut BBE is feasible only when 
rhode ld, 1] Vh,i, 7. For instance, it is necessary 
that f,, 2”, . To handle arbitrary n,, m,;,/,,;; 22, we may 


hij 
modify Se step and change p,,, q);,1%, accordingly: 


A General BBE 


Step I’. Choose (m,-1) PSU’s by SRS with 
replacement from n, PSU’s in the sample, 
h=1,...,H. Denote the candidate set by 
{PSU,,:i=1, 2,...., —1}. For each PSU 7 in 
the sample in stratum h, we: (a) keep it in the 
bootstrap sample with probability 


i Lathes 
2 d—np)’ 


(3.4) 


ji — 


or (b) replace it with one selected randomly 
from {PSU,,:i=1,2,...,, —l}. If (a) is the 
case, go to Step II’. 

For hi kept at Step I’, choose (m,; —1) SSU’s 
by SRS with replacement from m,, SSU’s in 


PSU hi. Denote the candidate set by 
{SSU,,,: 7 =1,2,...,m,; -f. For each SSU 


Step IT’. 
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hij in PSU hi kept at Step I’, we: (c) keep it 
in the bootstrap sample with probability 


2 p, (i-m;,) 


or (d) replace it with one selected randomly 
from {SSU,,,;: 7 =1,2,...,m,; —l}. If (c) is the 
case, go to Step III’. 


For hij kept at Step II’, choose /,,, -1 USU’s 

by SRS with replacement from /,, USU’s in 

SSU hij in PSU hi. Denote the candidate set 

by SUSU pec ec Uri meht open Ol geen 

USU hijk in SSU hij in PSU hi, we: (e) keep 

in the bootstrap sample with probability 
L fin Saw (1 Wan 


Tot tae if wcmel lewis’ i 


Dhi (3.5) 


Step III’. 


(3.6) 


or (f) replace it with one randomly selected 
from {USUy k= Way. i 
It is readily seen that p,, 9); 7% €[0, 1) V 2,5 Mrs lpi 2 2- 

The reason for randomly selecting a candidate set in the 
general BBE can be explained as follows. To fix the idea, 
consider single-stratum one-stage SRSWOR. Let p be a 
bootstrap sample mean under the short cut BBE with some 
arbitrary p <[0,1]. Then, it can be shown that V.(y ) = 
n'\(1—n')s*(1— p*), where s* =>; (y,-y)Mn-)D). 
Note that V.(y ) is monotone decreasing with respect to p 
in [0,1]. So, min, %(Y )=0 and max, %e( ) = 
mn ak ot ve <n’, then max, V.(¥ ) < v(/). 
The key idea of the general BBE 1s that we can make 
max , V.(y ) greater than v(y) by putting extra variation 
into unit replacement through randomly selecting a 
candidate set. 

It can be shown that both the short cut BBE and the 
general BBE provide consistent variance estimation for 
smooth functions of estimated population totals. Moreover, 
under appropriate regularity conditions for the population 
distribution function, they also provide consistent variance 
estimation for sample quantiles. In addition, both BBE 
methods use resample sizes equal to the original sample 
sizes. This can be a desirable property when we deal with 
imputed survey data (see Saigo, Shao and Sitter 2001). 

It is not difficult to extend the BBE approach to designs 
with more than three stages. For example, for a four stage 
stratified design, a USU at the fourth stage within stratum / 
is kept with probability 


Leip; iSVR ieee ‘te gan yd- Saniik ) 
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or replaced in the short cut BBE, where g,,,, is the fourth 
stage sample size and /,,,, is the fourth stage sampling 
fraction. Further extensions are analogous. 

The general BBE randomizes a candidate set in order to 
merely fix infeasibility of the short cut BBE. This idea has 
similarities to the approximately Bayesian bootstrap of 
Rubin and Schenker (1986). 

A disadvantage of the general BBE versus the short cut 
BBE is that the former requires, on the average, 
dn (%, — V+ Pdi My — D+ Pp Di Mi DX; Gay —D} more 
random number generations than the latter, where p,,q,,, 
and 7,,; are given by (3.4), (3.5), and (3.6), respectively. 
This may be time-consuming when the sample sizes and/or 
the number of strata are large. To reduce random number 
generations in the general BBE, one can create a candidate 
set by randomly deleting one unit from the original sample 
and use 


D, = (m, +1/2) —/(n, +1/29 =n, 1+ f,), (3.7) 
Ini= (m+ 1/2) —./(m,; + 2). — fi Py Mg (1 ce ER:)) 
Types hbk?) 

(3.9) 


it Chi a eas ac Pinafore paie (1 a ani )> 


instead. It can be shown that p,,, 4,;,%; €[0, 1]. The proof 
for this modified version of the general BBE is similar. 


4. A Simulation Study 


In this section, we perform limited simulations to 
examine the BBE for ratio estimation and quantile esti- 
mation. For simplicity, we consider two-stage SRSWOR 
and restrict to a single stratum. 


4.1 General Description of Simulation 


A single-stratum finite population is generated by the 
following procedure and fixed over all simulation runs to 
observe design-based properties of the BBE. First, the 
average of the auxiliary variables in cluster 7 is generated by 
fe Ni Gayton “ht 2c. VN. hen,» the auxiliary 
variable x, of unit & in cluster i is generated by 


Kee Ui Sik ieee Moi 1325...) 0» (Aal) 


where ¢,, ~ N(0, (1 —p)o’/p). The target variable y, of 
unit k in cluster 7 is obtained by 

Yp=atbx, + ef(kK al, 20... $Mg3 iS, 25...,N), 4.2) 
where e, ~N(0,0°/4). The parameter values used are 
u=100,0o=10,p =0.1(0.3),a=0, and b=1, and two- 
stage SRSWOR is used throughout the simulation study. 
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4.2 Ratio Estimation 


Let “N =50, n=15, M,'=20- and 'm, =3, tor 7=1, on 

Consider the ratio estimator of the population total, Y, 
a AG 

where X¥ =>%, vit kal Xt is the population total of the x’s 
R=Y/X,¥ = DALY, =D (N/m) YX =e eg ~ 
Lier (NM, In, dia Ape), ni = (Mi, / my Xe Ye and X 
(M,,,/™m, Ui X pit: 

For the purpose of comparison, we consider a number of 
alternate variance estimators that are available in this simple 
context: 


1) The conventional variance estimator is denoted 


: TS ASC Cre 
Vo (Yr) = N i Aa 
m sis Mi = fa) Sa01. (4.3) 


Ee; 


where f, =n/N, f,,=m,/M, and 


$a = a» (y,—-Rx, y /(m, —1). 


2) The delete 1 PSU at a time jackknife corrected for the 
first-stage sampling fraction is sometimes used, even 
though it is not entirely correct, 


vin) =0- AD Can od el ae (4.4) 


where Y, ri) 1S the estimator recalculated with the he 


PSU removed and peers » Via, ie 
3 


— 


An externally weighted jackknife (see Folsom, Bayless 
and Shah 1971) can be derived that corrects for both 
stages of sampling as 


Vow (Qo jeyii—= aie es 


m A fs 
i ion (-f,; setieiks (4.5) 


Tsai 
where Y, R(i) is the 7 * jackknife pseudo value by deleting 
| ao liga ei is the ij jackknife pseudo value by 
Pay UDitee ee W. iar: Pinks =); ws and 
Fac.) = Dy Yaqyy ™- 
4) A model-assisted variance estimator is also available 


(see Sarndal, Swensson and Wretman (1992), equation 


(8.10.6), 
ee) SOL Oy (4.6) 


We use B=100 bootstrap resamples in each of 
S=1,000 simulation runs. The true MSE’s are 
approximated by 10,000 simulation runs and we use Monte 
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Carlo estimates of percent relative bias and coefficient of 
variation of the various variance estimators as measures of 
their relative performance, as well as, empirical coverage 
probabilities of 90% confidence intervals. 

We see in Table | that vgp.,¥),V¥.,; and v,,, perform 
comparably and well, except that the CV of the resampling 
methods are a bit higher than the non-resampling methods, 
as is typical. The delete 1 PSU at a time jackknife performs 
poorly. 

To investigate the conditional properties, we ordered the 
1,000 simulation runs on X/X and divided the runs into 
20 equally sized groups. For each group the average of each 
variance estimator is calculated. Figure 1 plots these 
grouped averages for each variance estimator (excluding v,, 
since it has large negative bias) versus the grouped average 
X/X, for p =0.3. The true MSE is included in the plot, as 
well. This is a similar plot to that used by Royall and 
Cumberland (1981a, 1981b). One can see that v,;,, tracks 
the true MSE much like v,,, and v,,,, whereas v) does 
not. Thus, the BBE seems to have a desirable conditional 


property. 


Table 1 
Comparison of Variance Estimators for Y, 


p % Bias CV Coverage (90%) 
0.1 vo —1.70 0.28 89.2 
Venp —0.62 0.33 88.9 
Vy) —0.33 0.30 89.4 
Voj —26.55 0.39 80.5 
vie —0.39 0.30 89.4 
0:37 0 —0.67 0.28 86.6 
Vann —1.63 0.33 86.5 
Vaiss —0.74 0.29 86.5 
Voj —26.85 0.39 80.2 
v —0.87 0.29 86.4 


MSEc, Ec 


Figure 1. MSEc and Ec(v) for the ratio estimation. 
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4.3 Quantile Estimation 


For quantile estimation, we set N=100,n=30, 
M,=100 and m, =10, for i=1,...,n. We use B=500 
bootstrap resamples in each of S =5,000 simulation runs. 
The true MSE’s are approximated by 50,000 simulation 
runs. Only the results for v,,, and v,,, when p=0.1 are 
summarized in Table 2 because those when p=0.3 are 
similar. We see that the BBE method performs quite well, 
with a slight upward bias, while the externally weighted 
jackknife method has serious bias because of its in- 
consistency in variance estimation for quantiles. 


Table 2 
Performance of vgpy and v,,,; for the 0.10, 0.25, 0.50, 0.75 
and 0.90 quantiles 
VBBE Vewj 

Quantile %Bias CV Coverage(90%) “%Bias CV Coverage (90%) 
0.10 840 0.51 87.7 51.87 1.93 81.3 
O25" 62) 0.42 88.2 21.19 1.28 83.3 
O50) ty 2535 0:37, 87.4 14.27 1.00 83.0 
OFTSO:239 40:42 87.8 28.07 33 83.4 
0.90 632 0.50 88.0 54.47 2.05 80.3 


5. Application to the 1997 National Survey 
of Prices in Japan 


The objective of the NSP is to analyze price formations 
of major consumers’ goods, such as food, clothes and home 
appliances. To this end, quantile estimation plays a central 
role, and many quantile estimates based on several post- 
stratifications are included in the NSP reports. 

The stratified multistage sampling used in NSP 1997 is 
summarized as follows: 


Stratification. Municipalities form the PSU’s and are 
stratified into 537 strata, first according to prefectures and 
economic sphere that each municipality forms and then 
further by their population sizes. 


First Stage Sampling. These PSU’s are selected via 
SRSWOR independently within each stratum. An overview 
of the first-stage sampling fractions is given in Table 3. 


Second Stage Sampling. In a selected municipality, all the 
large scale outlets are enumerated. In other words, single 
stage cluster sampling is employed for large scale outlets. 
For small scale outlets, on the other hand, a sampled 
municipality is divided into survey areas (SSU’s) each 
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consisting of about 100 outlets. Systematic sampling is used 
to sample survey areas. The sampling fractions at the second 
stage are between 0.1 and 1.0. 


Third Stage Sampling. In each selected survey area, 40 
outlets (USU’s) are chosen by ordered systematic sampling 
with respect to the types of outlets and the annual sales 
reported in the 1994 Census of Commerce. 


Strictly speaking, there is no valid variance formula for 
the NSP data because it contains systematic sampling. For 
estimating variance, however, it is assumed that systematic 
sampling can be approximated by SRSWOR. Even under 
this simplified condition, there is no closed variance formula 
for sample quantiles. In fact, no variance estimates are 
associated with estimated price quantiles in the NSP report, 
while the average prices are reported with their variance 
estimates. 

In this section, we apply the short cut BBE to the NSP 
data, assuming that systematic sampling can be approxi- 
mated by SRSWOR. Some strata have only one PSU. In 
addition, /,,<;,' in some strata. Such strata are grouped 
into adjacent strata so that p, given by (3.1) is in [0, 1]. 
After grouping, there are more than 280 strata. The effect of 
reforming strata is assumed to be negligible. 


Table 3 
The First Stage Sampling Fractions in NSP 1997 
Area Category Population #ofPSU’s Sampling Sample 
Size Fraction Size 
Cities = 100,000 Uy)| 1/1 DOA 
Cities 50,000 — 99,999 220 2/3 179 
Cities < 50,000 224 1/3 80 
Towns and villages = 40,000 3) 1/5 4 
Towns and villages < 40,000 2,536 1/15 187 


After reforming strata, the short cut BBE is employed in 
those strata composed by cities. On the other hand, the with- 
replacement bootstrap (Shao and Tu 1995, page 247) using 
resample size (m, —1) is used in those composed of towns 
and villages, where the first stage sampling fractions are 
small. The quantile estimates and their standard errors for 
selected commodities in small-sized outlets are shown in 
Table 4. Note that the prices of a given commodity are 
discrete. However, we apply the bootstrap as if prices of 
commodities are continuous. This approximation should be 
acceptable for many commodities, but not for very 
inexpensive ones, since in such a case, a large percentage of 
observations concentrate on a specific price and the 
estimated standard error can be 0. 
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Table 4 
Sample Quantiles (Standard Errors) of Selected Commodities for Small Outlets in NSP 
Commodity p 0.10 0.25 0.5 0.75 0.90 
Rice (5kg)* Sample quantile 239.4 255.2 278.3 299) 315.0 
(10 yens) (standard error) (0.24) (0.53) (0.21) (0.02) (0.61) 
Instant Coffee (1 bottle)” Sample quantile 714 788 859 893 914 
(yen) (standard error) (0.13) (0.40) (0.00) (2.68) (1.43) 
Beer (24 cans)° Sample quantile 467.3 500.0 536.8 549.4 549.4 
(10 yens) (standard error) (1.01) (0.64) (0.82) (0.00) (0.00) 
PC Sample quantile 248.8 260.4 299.3 346.5 375.9 
(1,000 yens) (standard error) (2.03) (0.35) (3.25) (7.17) (1.48) 


The specified brands “Koshihikari; "Nescafe Gold Blend, 100g; “Sapporo (Nama) Black Label, 350ml; 


¢NEC PC9821 NW133/D14. 


6. Conclusions 


The bootstrap is useful for estimating variances in 
complex surveys, particularly when quantile estimation is 
important. We have proposed two Bernoulli-type bootstrap 
methods that can easily handle multi-stage stratified 
SRSWOR designs where sampling fractions are large: the 
short cut BBE and the general BBE. In both methods, a 
sampling unit at a given stage is either kept or replaced with 
preassigned probabilities to construct a bootstrap sample. 
The general BBE has an advantage in that it can handle any 
combination of sample sizes > 2 although it requires more 
random number generations than the short cut BBE. As an 
illustration, we applied the short cut BBE to Japanese 1997 
National Survey of Prices data. 


Acknowledgements 


The second author was supported by the Japan Statistical 
Association. The third author was supported by a grant from 
the Natural Science and Engineering Research Council of 
Canada. The authors thank the Statistics Bureau, Ministry of 
Public Management, Home Affairs, Posts and Tele- 
communications, and the Ministry of Economy, Trade, and 
Industry, Japan, for providing the 1997 NSP data. 


References 


Bickel, P.J., and Freedman, D.A. (1984). Asymptotic normality and 
the bootstrap in stratified sampling. The Annals of Statististics, 12, 
470-482. 


Booth, J.G., Butler, R.W. and Hall, P. (1994). Bootstrap methods for 
finite populations. Journal of the American Statistical Association, 
89, 1282-1289. 


Statistics Canada, Catalogue No. 12-001-XPB 


Folsom, R.E., Bayless, D.L. and Shah, B.V. (1971). Jackknifing for 
variance components in complex sample survey designs. 
Proceedings of the Social Statistics Section, American Statistical 
Association, 36-39. 


Gross, S. (1980). Median estimation in sample surveys. Proceedings 
of the Section on Survey Research Methods, American Statistical 
Association, 181-184. 


Kovar, J.G., Rao, J.N.K. and Wu, C.F.J. (1988). Bootstrap and other 
methods to measure errors in survey estimates. Canadian Journal 
of Statististics, 16, Supplement, 25-45. 


McCarthy, P.J., and Snowden, C.B. (1985). The bootstrap and finite 
population sampling. Vital and Health Statistics, Serie 2, 95, 
Public Health Service Publication, 85-1369, Washington, DC: 
U.S. Government Printing Office. 


Rao, J.N.K., and Wu, C.F.J. (1988). Resampling inference with 
complex survey data. Journal of the American Statistical 
Association, 83, 231-241. 


Royall, R.M., and Cumberland, W.G. (1981a). An empirical study of 
the ratio estimator and estimators of its variance. Journal of the 
American Statistical Association, 76, 66-77. 


Royall, R.M., and Cumberland, W.G. (1981b). The finite population 
linear regression estimator: An empirical study. Journal of the 
American Statistical Association, 76, 924-930. 


Rubin, D.B., and Schenker, N. (1986). Multiple imputation for 
interval estimation from simple random samples with ignorable 
nonresponse. Journal of the American Statististical Association, 
81, 366-374. 


Saigo, H., Shao, J. and Sitter, R.R. (2001). A repeated half-sample 
bootstrap and balanced repeated replication for randomly imputed 
data. Survey Methodology, 27, 189-196. 


Sarndal, C.-E., Swenson, B. and Wretman, J. (1992). Model Assisted 
Survey Sampling. New Y ork: Springer-Verlag. 

Shao, J., and Sitter, R.R. (1996). Bootstrap for imputed survey data. 
Journal of the American Statistical Association, 91, 1278-1288. 
Shao, J., and Tu, D. (1995). The Jackknife and Bootstrap. New Y ork: 

Springer-Verlag. 
Sitter, R.R. (1992a). A resampling procedure for complex survey 
data. Journal of the American Statistical Association, 87, 755-765. 


Sitter, R.R. (1992b). Comparing three bootstrap methods for survey 
data. Canadian Journal of Statististics, 20, 135-154. 


Survey Methodology, December 2006 
Vol. 32, No. 2, pp. 157-163 


Statistics Canada, Catalogue No. 12-001-XPB 


Geometric Versus Optimization Approach to Stratification: 
A Comparison of Efficiency 


Marcin Kozak and Med Ram Verma ' 


Abstract 


In this paper, the geometric, optimization-based, and Lavallée and Hidiroglou (LH) approaches to stratification are 
compared. The geometric stratification method is an approximation, whereas the other two approaches, which employ 
numerical methods to perform stratification, may be seen as optimal stratification methods. The algorithm of the geometric 
stratification is very simple compared to the two other approaches, but it does not take into account the construction of a 
take-all stratum, which is usually constructed when a positively skewed population is stratified. In the optimization-based 
stratification, one may consider any form of optimization function and its constraints. In a comparative numerical study 
based on five positively skewed artificial populations, the optimization approach was more efficient in each of the cases 
studied compared to the geometric stratification. In addition, the geometric and optimization approaches are compared with 
the LH algorithm. In this comparison, the geometric stratification approach was found to be less efficient than the LH 
algorithm, whereas efficiency of the optimization approach was similar to the efficiency of the LH algorithm. Nevertheless, 
strata boundaries evaluated via the geometric stratification may be seen as efficient starting points for the optimization 
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approach. 


Key Words: Optimum stratification; Geometric 


algorithm. 


1. Introduction 


Gunning and Horgan (2004) proposed a stratification 
algorithm based on a geometric progression. For the sake of 
simplicity, we will call this technique the “geometric 
approach to stratification,” “geometric stratification,” or just 
“geometric approach.” The geometric stratification aims to 
equalize values of the coefficient of variation of a 
stratification variable within strata, based on the assumption 
that the variable is uniformly distributed within each 
stratum. Gunning and Horgan (2004) showed that their 
algorithm is much easier to implement and more efficient 
than the classical cumulative root frequency method 
(Dalenius and Hodges 1959) as well as the Lavallée and 
Hidiroglou (LH) algorithm (Lavallée and Hidiroglou 1988). 
Horgan (2006) compared the geometric stratification with 
the Dalenius and Hodges’ (1959), Ekman’s (1959), and 
Lavallée and Hidiroglou (1988) procedures; again, in their 
study the geometric stratification occurred to be the most 
efficient among the procedures compared. Gunning, Horgan 
and Yancey (2004) applied this method to stratify 
accounting populations. 

Like the cumulative square root frequency method, the 
geometric approach is an approximate _ stratification 
technique, and hence the stratification points it provides 
may be quite far from optimum stratification points. On the 
other hand, there exist approaches, especially for univariate 
Stratification, that lead to near-optimum stratification points. 
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Stratification; 


Numerical Optimization; Lavallée-Hidiroglou 


These approaches are based on the use of self-implemented 
algorithms or numerical optimization methods to provide 
strata boundaries (e.g., Lavallée and Hidiroglou 1988; 
Lednicki and Wieczorkowski 2003; Kozak 2004). Such 
methods, however, usually require initial strata boundaries 
to start an optimization process; approximate stratification 
methods can be employed to find such initial points. Of 
course, initial strata boundaries should be of high quality, as 
their low quality may cause the optimization to provide a 
local minimum (Rivest 2002). 

Many surveys deal with positively skewed study 
variables. If this is the case, it is important to take into 
account this attribute when stratifying a population. Many 
researchers have attempted to create stratification methods 
that would construct a so-called “take-all” stratum (e.g., 
Glasser 1962; Hidiroglou 1986), from which all the 
elements are selected in the sample with probability 1. In 
stratified sampling, this is the best manner of dealing with 
positively skewed variables. Such methods are usually more 
efficient (certainly, only if a population is positively 
skewed) than stratification methods in which a take-all 
stratum is not constructed. A take-all stratum is not 
constructed in the geometric stratification (Gunning and 
Horgan 2004). 

The aim of this paper is to compare the efficiency of the 
geometric stratification, proposed by Gunning and Horgan 
(2004), and two optimization approaches to stratification 
(Lavallée and Hidiroglou 1988; Lednicki and 
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Wieczorkowski 2003; Kozak 2004), which is based on the 
use of numerical optimization methods. 


2. Stratification Approaches Compared 


Suppose we aim to stratify an N—element positively 
skewed population, U, based on an N-vector x= 
tert, ely of values, known at the outset (i.e., prior to 
the study), of a stratification variable X. 

In this paper, we consider two stratification problems. In 
the first problem, L strata are to be constructed subject to a 
given sample size n. Suppose we are looking for an (L + 1) 
—vector of strata boundaries k =(kp,..., k, Nad CC tile 
...<k,,k, being the minimum and k, the maximum value 
of X) that minimizes the variance of an estimator of the 
population mean of X under stratified sampling with simple 
random sampling without replacement within strata (STiS/) 
sampling combined with a take-all stratum approach. (Note 
that we treat the stratification variable as identical to the 
corresponding survey variable.) The variance of x,, is given 
by 


Ag L N he wl ] Np 
ype ais Pie re i D Ls (1) 
h=l Ny k=1 


where n, is the sample size from the h™ stratum, N,, is the 
size of the h™ stratum, S; is the population variance of X 
restricted to the h' stratum, X, is the estimator of the 
population mean of X under STS/ sampling, x, is the 
estimator of the population mean of X in the h™ stratum 
under simple random sampling without replacement (S/) 
sampling, and x,, is the value of X for the k™ sample 
element of the /™ stratum and h=1,..., L. 

The optimum sample allocation, which is in our problem 
obtained by minimizing the variance (1) subject to a given 
sample size n, is given by the following Neyman-optimum 
formula adjusted to a take-all stratum approach (Lednicki 
and Wieczorkowski 2003): 


N, Sp 
a N,S), 


h=| 


n, =(n—N,) 1A iy oa 6 RB (2) 


The geometric approach to stratification aims to equalize 
values of the coefficient of variation of X within the L strata. 
It simply consists of applying the following formula based 
ona geometric progression (Gunning and Horgan 2004) 


a a Ee nd de (3) 
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where a=min(X),k, =max(X), and r=(k,/k, yon 
The formula (3) is based on the assumption that X is 
uniformly distributed within each stratum. 

The optimization approach applied to this particular 
stratification problem is based on the numerical optimiza- 
tion of the following problem: Minimize 


F(K) =V (Xy), (4) 


where V(x,,) is the variance (1) under the optimum 
allocation (2), subject to constraints 


Ny ee and. 2.51 SAN lor.) = lay, lode (5) 
and 
Ny =n =No (6) 


Sometimes, when one wants to obtain more or less equal 
levels of precision of estimation in each stratum, a power 
allocation may be applied (Bankier 1988; Rivest 2002; 
Lednicki and Wieczorkowski 2003): 


_ NN) 


ee e(O)1) hols,. oie AD 
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The optimization approach is more difficult to apply than 
the geometric stratification approach due in large part to the 
fact that the algorithm for the geometric approach is signi- 
ficantly more simplistic than for the optimization approach. 
An optimization method has to be chosen from among 
various available methods. Lednicki and Wieczorkowski 
(2003) used the simplex method of Nelder and Mead 
(1965); however, more efficient methods, which often 
require self-implemented algorithms (e.g., Kozak 2004), can 
be applied, too. 

Note that the geometric stratification does not take into 
account the formulae for the variance (1), the sample 
allocation (2), and the constraints (5). It may happen that 
one of the constraints (5) is not fulfilled. For these reasons, 
the geometric stratification is an approximate stratification 
procedure. 

In this study, the algorithm proposed by Kozak (2004) 
was applied to stratify several populations. It is a random 
search algorithm adjusted to the problem of stratification. It 
is a simple algorithm; in each step, a stratum boundary is 
randomly selected and randomly changed. If the new set of 
strata boundaries is better than the previous one, the new 
one replaces the previous one. In the Appendix, the 
algorithm based on the paper by Kozak (2004) is given in 
detail. 
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The second problem considered in the paper is 
construction of strata that minimize a sample size from a 
population with respect to a given level of precision of 
estimation (the precision of estimation being given by the 
variance of an estimator of the population mean or total). 
The Lavallée-Hidiroglou (LH) algorithm (Lavallée and 
Hidiroglou 1988) can be seen as a particular optimization 
method to solve this particular stratification problem; it does 
not, however, work in other problems, e.g., in the one 
considered earlier. For details of the algorithm, see the paper 
by Lavallée and Hidiroglou (1988). Besides the LH 
algorithm, the geometric stratification and random search 
method were applied to construct the strata. 

The R language and environment (R Development Core 
Team 2005) was used to perform all the computation work 
in the present study. 


3. Numerical Comparison of Efficiency of the 
Approaches in Stratification Under 
Fixed Sample Size 


In this section, we compare two stratification approaches, 
the geometric stratification (geom) and optimization 
approach (optim), applied to a problem of searching for the 
strata boundaries that minimize the variance of the 
considered estimator with respect to a fixed sample size. In 
order to perform the comparison, five artificial populations 
of various sizes (from 2,000 to 10,000) were generated. 
Their summary statistics are presented in Table 1; the 
histograms of the stratification variables in the populations 
are given in Figure 1. In each case, the stratification variable 
was positively skewed (the skewness ranged between 1.40 
for the 1“ population to 5.02 for the Me population). As it is 
usually the case in real populations, values of the 
stratification variables were integers. The sample size, 7,, 
from the i population was n, = fN,, where f =0.15 is 
an assumed sample fraction and N, is the size of the i™ 
population. 


Table 1 
Summary Statistics for Studied Artificial Populations 


Population Size Range Skewness Mean _ Variance 


1 4,000 3-72 1.40 16.11 45.8 
2 4,000 243-—28,578 2.66 2,823.95 4.8 x 10° 
3 2,000. 6—2,793 3.55 224.12 6.0x 10° 
4 10,000 62—74,398 4.20 3,616.41 2.1 x 10’ 
5 2,000 259-186,685 5.02 9,265.36 1.1 x 10° 


First, each population was stratified using the geometric 
stratification method into 4, 5, 6, and 7 strata. Then, the 
optimization approach was applied; as initial parameters in 
the optimization approach, the strata boundaries determined 
via the geometric stratification were used. 
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Like Gunning and Horgan (2004), to compare the 
efficiency of the two approaches, the relative efficiency was 
calculated via the formula: 


ff he. V scouglMas,) 
e geom, optim ~ V (x Na 
optim \~*st 


(8) 


where Voom (%) and Ve tim %) are the variances (1) under 
the geometric and optimization approach, respectively. In 
addition, we calculated the coefficients of variation of the 


estimator of the population mean under both approaches: 


4] ae (Xe ) , AV opin (xy; ) 


Ve... = ON = (9) 


geom = optim = 
Xst Xt 


Table 2 contains the values of the relative efficiencies (8) 
and the coefficients of variation (9) for each combination 
studied (population x number of strata). 


Table 2 
Coefficients of Variation of the Estimator of the Population Mean 
Under the Geometric Stratification (CV geom) and Optimization 
Approach (CVoptim), and Efficiencies of the Geometric 
Stratification Relative to the Optimization 
Approach (Cir com,optxa) 


Number of strata L CV CV nam Cll comsoptin 
Population 1 
4 0.0086 0.0056 hss 
5 0.0070 0.0042 1.66 
6 0.0057 0.0034 1.66 
7 0.0051 0.0029 LaiS 
Population 2 
4 0.0116 0.0084 he 
S) 0.0095 0.0065 1.47 
6 0.0085 0.0051 1.66 
rL 0.0073 0.0042 L72 
Population 3 
4 0.0235 0.0133 1.76 
5 0.0174 0.0100 1.74 
6 0.0146 0.0081 1.80 
i 0.0129 0.0067 1,91 
Population 4 
4 0.0104 0.0063 1.64 
5 0.0089 0.0047 1.88 
6 0.0073 0.0038 1.93 
7 0.0064 0.0032 2.00 
Population 5 
“ 0.0235 0.0134 1.76 
5 0.0185 0.0100 1.86 
6 0.0161 0.0080 2.00 
vE 0.0134 0.0074 1.82 


In each case, the optimization approach was more 
efficient than the geometric stratification. The efficiency 
was smaller than 1.5 for only two combinations; in the rest 
of combinations, it ranged between 1.5 and 2. Usually, the 
more strata constructed the greater the gain in efficiency. 
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Figure 1. Histograms of stratification variable in studied artificial populations. 


4. Numerical Comparison of Efficiency 
of the Stratification Approaches Under 
Fixed Level of Precision of Estimation 


Gunning and Horgan (2004) and Horgan (2006) com- 
pared the geometric stratification with the Lavallée and 
Hidiroglou (Lavallée and Hidiroglou 1988) algorithm and 
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found that the former was usually more efficient. In this 
section, we compare the three stratification approaches: the 
geometric stratification, the LH algorithm, and the optimiza- 
tion approach via a random search method. In this study, the 
same five populations as in the previous section were used 
(see Table 1 and Figure 1). 
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The relative efficiencies of two approaches were 
evaluated as 
n;(CV) 


ee (10) 


nt ane ey)" 


where i and j are the indices of the stratification approaches 
(i, 7 = geom, optim, LH), and n,(cv) and n,(cv) are the 
minimum sample sizes required to obtain a desired level of 
precision (cv) under the i” and jj" approaches, 
respectively. 

Using the three approaches, each population was 
stratified into L=4,...,7 strata; the required level of 
precision was 0.01 in each case. Minimum sample sizes 
required for this level of precision and relative efficiencies 
(10) are given in Table 3. 


Table 3 
Minimum Sample Sizes Required to Obtain a Value Equal to 0.01 
for the Coefficient of Variation of the Estimator of the Population 
Mean, Under the Geometric Stratification (Mgeom), Optimization 
Approach (“optim)» and LH Algorithm (7,;;); and Efficiencies of 
the Geometric Stratification Relative to the Optimization 
Approach (eff,com, optim)» the Geometric Stratification 
Relative to the LH Algorithm (effgeom, ta)» and 
LH Algorithm Relative to the Optimization 


Approach (eff, jy, optim) 


Number 
of strata L Ageom Hoptim ALA effscom, optim efizcom, LH effin, optim 

Population 1 

4 805 496 496 1.63 63 1.00 

5 613 344 344 1.78 1.78 1.00 

6 460 Jey) Nay 1.83 1.83 1.00 

‘i Soy) 192 192 1.86 1.86 1.00 
Population 2 

4 483 248 259 1.94 1.86 1.04 

5 329 154 163 2.14 2.02 1.06 

6 224 113 iW) 1.98 1.92 1.03 

i 180 83 83 DENG, WAG 1.00 
Population 3 

4 782 410 411 1.91 1.90 1.00 

5 601 303 304 1.98 1.98 1.00 

6 495 242 241 2.04 2.05 1.00 

7 422 195 195 DeAN! 2.16 1.00 
Population 4 

4 839 409 409 2.05 2.05 1.00 

5) 650 301 301 2.15 Dil 1.00 

6 552 240 242 2.30 2.28 1.01 

4 2a 7200, 2200 = - 1.00 
Population 5 

4 1,768 894 894 1.98 1.98 1.00 

5) 1,274 628 628 2.03 2.03 1.00 

6 949 459 459 2.07 DAF, 1.00 

i 758 355 355 2.13 2.13 1.00 


' There were numerical problems with obtaining stratum boundaries (sample 
sizes from some strata were bigger than the sizes of these strata). 


From the results it follows that the optimization approach 
was more efficient than the geometric stratification; this 
outcome was obtained for each population and number of 
strata. The relative efficiency was always greater than 1.6. 
Moreover, an interesting conclusion follows from the 
comparison of the efficiency of the geometric and LH 
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stratifications. As already mentioned, Gunning and Horgan 
(2004) and Horgan (2006) found the geometric stratification 
more efficient than the LH algorithm. On the contrary, in 
our study, the LH algorithm was always more efficient than 
the geometric stratification. This situation occurred also for 
other generated populations of various sizes and skewness 
(results not included in this paper). Nevertheless, we do not 
state that the LH algorithm is always more efficient than the 
geometric stratification. It may happen that the geometric 
stratification will be better, as Gunning and Horgan (2004) 
and Horgan (2006) obtained in their studies. 

From the comparison of the LH algorithm and the 
optimization approach it follows that both approaches 
provides stratification points leading to similar sample sizes. 
In some cases, the LH stratification was slightly better and 
in some other cases slightly worse than the optimization 
approach. Nevertheless, these differences do not mean that 
we could indicate either of these two approaches as more 
efficient. In fact, these two approaches have the same aim 
(in this particular stratification problem) and they just differ 
in the algorithm to achieve this aim. In summary, on the 
basis of our results we conclude that, in general, the LH 
stratification and optimization approach are more efficient 
than the geometric stratification. 


5. Conclusions 


The stratification technique based on a geometric 
progression proposed by Gunning and Horgan (2004) has a 
significant advantage; namely, its algorithm is very simple 
to implement compared to the cumulative square root of 
frequency method of Dalenius and Hodges (1959) and to 
other stratification methods. It is, however, an approximate 
stratification procedure, so the stratification points it 
provides may lead to poor precision of estimation (or a large 
sample size required to achieve a required level of 
precision). Furthermore, it is likely that some of the strata 
constructed will not fulfill the constraints (5); e.g., some 
strata may be empty (so they would not comprise any 
population element) or/and sample sizes from some strata 
may be smaller than two or greater than their population 
SIZeS. 

In our study, the optimization approach (via the LH and 
random search algorithms) was more efficient than the 
geometric stratification for each population studied and 
number of strata constructed. Nevertheless, the strata 
boundaries provided by the geometric stratification can be 
seen as efficient initial parameters required in the 
optimization approach; they should not be considered, 
however, as the optimal or efficient strata boundaries. 
Furthermore, our results conclusively show that the 
geometric stratification is less efficient than the stratification 
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presented by Lavallée and Hidiroglou (1988), which is the 
result opposite to the one obtained by Gunning and Horgan 
(2004) and Horgan (2006). This problem needs further 
studies on real skewed populations; investigations on 
artificial populations univocally show that the LH algorithm 
and the optimization approach are more efficient than the 
geometric stratification. 

At first look, one could be surprised that the gain in 
efficiency after applying the LH and _ optimization 
approaches compared to the geometric stratification 
increases after increasing the number of strata. This can be 
easily explained. The aim of the geometric stratification is to 
equalize cvs of the stratification variable within the strata. 
Therefore, this is not the same aim as the aim of strati- 
fication, which is to optimize the efficiency of estimation or 
to minimize a sample size. Furthermore, there is no certainty 
that under the optimum stratification the distribution of the 
stratification/survey variable is uniform within the strata. 
These two sets of strata boundaries (i.e., provided by the 
geometric and optimization approaches) are not necessarily 
the same; in fact, they are likely different. 

Note that we applied the random search method as the 
algorithm of the optimization approach to stratification. In 
fact, Lavallée and Hidiroglou’s (1988) algorithm is a 
representative of optimization approaches, too. When the 
aim of stratification is to minimize a sample size required to 
achieve a desired level of precision, the two approaches will 
likely provide similar results, as they did in our study. 
Nevertheless, the random search algorithm may be applied 
to any stratification problem (i.e., any optimization function 
and its constraints), contrary to the LH algorithm, which is 
applicable only when a sample size is minimized with 
respect to a given level of precision. It is to be noted that the 
random search algorithm, as a global optimization method, 
provides random results. 

Our aim, however, was not to promote any of these two 
algorithms by showing that they are more efficient than the 
geometric stratification. In addition, we applied Nelder and 
Mead’s (1965) simplex method to stratify the populations 
(results not presented in the paper); its results were very 
similar to those of the LH and random search method 
algorithms. Each of these methods has some drawbacks. For 
instance, numerical difficulties may occur while using the 
LH algorithm (Slanta and Krenzke 1996); the random 
search method provides random results (Kozak 2004); 
Nelder and Mead’s (1965) method may be inefficient under 
large number of strata and large populations (Kozak 2004); 
and, in fact, none of the methods has been proven to provide 
optimum stratification points. Therefore, there is still a need 
of constructing a stratification algorithm that would be 
optimum irrespective of the situation (e.g., of a population 
size or variable’s skewness) and that would provide results 
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that are not random. Our main aim was to prove that the 
geometric stratification is not optimum, although the 
stratification points it provides may be useful as initial 
parameters in other approaches to stratification. 
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Appendix 


The algorithm given below was proposed by Kozak 
(2004); we have adapted some of its details to the general 
stratification problem. In the algorithm, we do not refer to 
the particular problem of stratification (i.e., we do not define 
the optimization function and its constraints), since the 
algorithm works for both problems presented in the paper as 
well as for other stratification problems. Where required, we 
refer to “optimization function” (which may be either the 
variance of an estimator considered or a sample size from a 
population) and “constraints” (which, depending on the 
optimization function, may be the constraints (5) and (6), or 
the constraints (5) combined with the constraint on the level 
of precision of estimation); certainly, other forms of the 
optimization function and its constraints may be considered 
as well. 

Let us define a vector a as follows. It takes values on the 
interval (1, V), N being the population size. Provided that a 
population is sorted by the values of a stratification variable 
X, two elements a, , and a, of the vector a define the 
stratum / in such a way that this stratum consists of the 
elements with the index J (which gives the order of an 
element in the population sorted) that a,,<I<a,, 
h=1,...,L,a), =0, a, = N. The algorithm is as follows. 

1. Sort the population by the values of the 
stratification variable. 


2. Choose an initial vector a, ie., the vector of initial 
strata boundaries. You may use random integers 
that satisfy the constraints, but practice shows that 
better results may be achieved by using approxi- 
mate strata boundaries obtained via some approxi- 
mate stratification methods. Calculate the value of 
the optimization function. Check the constraints; if 
they are not fulfilled, the initial points have to be 
changed. 
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3. For r=0,1,...,R repeat the following step: 


a. Generate point a’ by drawing one stratum 
boundary a, and changing it as follows 


d= a,+-f, 
Greer torr lhe Tad aan (11) 


where. 7) is ‘the. ‘random: integer: 
Jé (-p;-1)U (Lp), p. being a given integer 
chosen based on the population size (the larger 
the population, the larger the p value); usually, it 
should be between 3 and 5. 


b. Calculate the value of the optimization function. 


c. If the constraints are satisfied and the value of 
the optimization function under the vector a’ is 
smaller than the value under the vector a, accept 
the new vector, i.e. a,,,=a' (where a,,, is 
the vector of strata boundaries in a next 
iteration); otherwise do not accept the vector, 
1é., a,,, =a. 


4. Finish the algorithm if the stopping rule is fulfilled, 
e.g., if r=R, where R is given number of steps, or 
if in the last m (for instance, 50) steps the value of 
the optimization function did not change. Finally, 
calculate the vector k (the vector of final strata 
boundaries) on the basis of the values of the 
vector a. 
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Indirect Sampling: The Foundations of the Generalized 
Weight Share Method 


Jean-Claude Deville and Pierre Lavallée ! 


Abstract 


To select a survey sample, it happens that one does not have a frame containing the desired collection units, but rather 
another frame of units linked in a certain way to the list of collection units. It can then be considered to select a sample from 
the available frame in order to produce an estimate for the desired target population by using the links existing between the 
two. This can be designated by /ndirect Sampling. 


Estimation for the target population surveyed by Indirect Sampling can constitute a big challenge, in particular if the links 
between the units of the two are not one-to-one. The problem comes especially from the difficulty to associate a selection 
probability, or an estimation weight, to the surveyed units of the target population. In order to solve this type of estimation 
problem, the Generalized Weight Share Method (GWSM) has been developed by Lavallée (1995) and Lavallée (2002). The 
GWSM provides an estimation weight for every surveyed unit of the target population. 


This paper first describes Indirect Sampling, which constitutes the foundations of the GWSM. Second, an overview of the 
GWSM is given where we formulate the GWSM in a theoretical framework using matrix notation. Third, we present some 
properties of the GWSM such as unbiasedness and transitivity. Fourth, we consider the special case where the links between 
the two populations are expressed by indicator variables. Fifth, some special typical linkages are studied to assess their 
impact on the GWSM. Finally, we consider the problem of optimality. We obtain optimal weights in a weak sense (for 
specific values of the variable of interest), and conditions for which these weights are also optimal in a strong sense and 


independent of the variable of interest. 


Key Words: Indirect Sampling; Generalized Weight Share Method; Unbiasedness; Optimal Weights. 


1. Introduction 


To select the samples needed for social or economic 
surveys, it is useful to have sampling frames, i.e., lists of 
units intended to provide a way to reach desired target 
populations. Unfortunately, it happens that one does not 
have a list containing the desired collection units, but rather 
another list of units linked in a certain way to the list of 
collection units. One can speak therefore of two populations 
U4 and U® linked to each other, where one wants to 
produce an estimate for U’. Unfortunately, a sampling 
frame is only available for U~. It can then be considered to 
select a sample s* from U% in order to produce an 
estimate for U® by using the correspondence existing 
between the two populations. This can be designated by 
Indirect Sampling. 

Estimation for a target population U’ surveyed by 
Indirect Sampling can constitute a big challenge, in 
particular if the links between the units of the two popu- 
lations are not one-to-one. The problem comes especially 
from the difficulty to associate a selection probability, or an 
estimation weight, to the surveyed units of the target 
population. In order to solve this type of estimation 
problem, the Generalized Weight Share Method (GWSM) 
has been developed by Lavallée (1995) and Lavallée (2002), 
and presented also in Lavallée and Caron (2001). The 


GWSM provides an estimation weight for every surveyed 
unit of the target population U”. Basically, this estimation 
weight corresponds to a weighted average of the survey 
weights of the units of the sample s*. The GWSM is an 
extension of the Weight Share Method described by Ernst 
(1989) in the context of longitudinal household surveys. 

The purposes of this paper are to describe Indirect 
Sampling—the foundations underlying the GWSM-~and to 
obtain optimal weights from the GWSM that provide 
unbiased estimates with minimum variance. First, we will 
describe Indirect Sampling together with the GWSM in a 
theoretical framework that will use, for instance, matrix 
notation. The use of matrix notation for the GWSM has 
previously been presented by Deville (1998). Second, we 
will use this theoretical framework to state some general 
properties associated with the GWSM that include 
unbiasedness and transitivity. Transitivity is to go from the 
population U“ to a target population US, through an 
intermediate population U*. Third, we will show the 
correspondence between the matrix formulation and the one 
that has been described in Lavallée (1995), Lavallée (2002), 
and Lavallée and Caron (2001). Fourth, we will study the 
effect of various typical link matrices between U* and U? 
on the precision of the estimates obtained from the GWSM. 
Finally, we will assess the problem of optimality. We will 
obtain optimal weights in a weak sense (for specific values 
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of the variable of interest), and conditions under which these 
weights are also optimal in a strong sense and independent 
of the variable of interest. 


2. Indirect Sampling 


As mentioned in the introduction, with Indirect Sampling, 
we select a sample s* from a population U“ in order to 
produce an estimate for a target population U”. For that, we 
use the correspondence existing between the two popu- 
lations. For example, assume that we want to produce esti- 
mates for a population of children (collection units) while we 
only have a sampling frame of parents. The target population 
U® is the one of the children, but we need to select a sample 
of parents before being able to interview the children. This is 
illustrated in Figure 1. 
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Figure 1. Population U* of parents and population U? of 
children with the links between the two. 


Let the population U* contain N“ units, where each 
unit is labeled by the letter 7. Similarly, let the target 
population U* contain N* units, where each unit is 
labeled by the letter i. The correspondence between the two 
populations U* and U” can be represented by a link 
matrix © ,, =[8%; ] of size N4 = N? where each element 
chee >0. That is, unit 7 of U% is related to unit i of U? 
provided that Os. >0, otherwise the two units are not 
related to each other. For the above example, the link matrix 
is given by 
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Obtaining the link matrix link matrix © ,, =[0%;'] is a 
critical issue in Indirect Sampling. For the case where two 
units j¢U* and icU® are not linked, we simply set 
Om =(. When there is a link between two units j and i, 
the choice of 6% >0 is important. As we will see, it 
influences the precision of the estimates issued from Indirect 
Sampling. Now, in several applications, the values of cee 
for the linked units are simply set to 1. Of course, the values 
of Die for the linked units can be chosen to be different 
from 1. Lavallée and Caron (2001) discussed the use of the 
linkage weights obtained from a record linkage process 
between U“ and U” for assigning values to the 6%’. The 
linkage weights are proportional to the probability of two 
units j¢U* and icU® being linked. Since the choice of 
Of >0 for two linked units 7 and i can affect the 
precision of the estimates, it is natural to seek for those aS 
that will minimize the variance of the estimates. This 
optimization problem is considered in section 6 of the paper. 

With Indirect Sampling, we select the sample s* of n4 
units from U“ using some sampling design. Let x; be the 
selection probability of unit 7. We assume 74> 0 for all 
j€U“. For each unit 7 selected in s*, we identify the 
units i of U* that have a non-zero correspondence, ie., 
with 6%,’ >0. Let Q* be the set of the n” units of U* 
identified by the units jes’, ie, Q? = f{EU" |Ajes* 
and vee > 0}. For each unit i of the set Q’, we measure 
a variable of interest y, from the target population U’. Let 
Y = {),, «-» Vye}’ be the column vector of that variable of 
interest. In a practical view point, it is important to mention 
that although the sample size n* is usually determined in 
advance, the number of units n? is difficult to control 
because it depends on the selected sample s* and the link 
matrix © ,,. As a consequence, it turns out to be difficult in 
general to establish a budget for measuring the variable of 
interest y, Fortunately, in most applications (e.g., the 
parents-children case above), the number of links that start 
from a given unit 7 of s* is somewhat predictable (for 
example, a parent typically has one, two, or three children), 
which helps to assess how many units i of U” will finally 
be measured. 

We assume that for any unit j of s‘, the correspon- 
dences for i=l, ..., N® can be obtained. That is, we can 
identify all the links between the two populations by direct 
interview or by some administrative source for any sampled 
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unit j. Also, for any identified unit i of U*, we assume 
that the links for 7=1, ..., N 4 can be obtained (as men- 
tioned by Lavallée (2002), there are cases where this last 
constraint can be difficult to satisfy in practice. Referring to 
the example of parents and children, it might not be easy for 
a very young child, selected through his mother, to mention 
back his father, when the two parents are divorced. In order 
to simplify the discussion, such a problem of identification 
of links will be assumed to be negligible). Therefore, the 
values of the links need not to be known between the entire 
populations U“ and U”. In fact, we need to know the links 
(and consequently the values of OF ) only for the lines 7 
of @,, where jes“, and also for columns i of O45 
where i€Q?. 

Suppose that we are interested in estimating the total Y” 
of the target population U? where Y* =>, y,. We can 
also write Y° =1',Y where 1, is the column vector of 1’s 
of size N” (note that we use for simplification the notation 
1, instead of 1,,). Now let ae Da 0%" and let 
Chet We have 1’ 19 4p = {851 O52}. We 
then define the standardized link matrix ©,,= 
O ,; [diag(1',0 ype where diag(v) is the square matrix 
obtained by putting the elements of the row-vector (or 
column-vector) v in the diagonal, and 0 elsewhere. Note 
that in order for the matrix © ,, to be well defined, we must 
have [diag(1’,© ,, )|' to exist, which is the case if and only 
if 047 >0 for all i=1,..., N’. For the parents-children 
example, this means that every child must be linked to at 
least a parent. 


Result 1: 
The link matrix © ,, is a standardized link matrix if and 
only if 


Olle (2.1) 


The proof of Result 1 follows directly from the definition 
of a standadized link matrix. Using Result 1, we directly 
obtain Result 2 that can also be found in Deville (1998): 


Result 2: 
Vee 1s 


Nn4 NB a 


© ,,Y = Drea Q#? vie 


j=! i=l 


(2.2) 


Let us define the column vector Z=©,,Y of size N%. 
Considering each line of Z, the variable z, = sy Oe yands 
defined for each unit j of the population U* and measured 
for each unit j es“. 

For estimating Y’, we want to use the values of y, 
measured from set Q?. For this, we will use an estimator of 
the form: 
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(2.3) 


NB 
a > wy; 
i=t 


where w, is the estimation weight of the unit i of Q”, with 


w,=0 for i¢Q?. Let W' = {w, ..., W,»}- The estimator 
(2.3) can be rewritten as 

Yea Ww'y. (2.4) 

Usually, to get an unbiased estimate of Y*, one can 


simply use as the weight the inverse of the selection 
probability 7? of unit i. As mentioned by Lavallée (1995) 
and Lavallée (2002), with Indirect Sampling, this probability 
can however be difficult, or even impossible, to obtain. It is 
then proposed to use the GWSM, which is defined as 
follows. 

etter. a Teatl and let I, =diag(m“) be the 
diagonal matrix of size N“ x N* containing the selection 
probabilities used for the bmn of sample s*. 
Accordingly, let t* = {¢7, ..., wa where is = ieityiew, 
and 0 otherwise. Let T, = a ) be the iggoeel pale 
of size N*xN% containing the indicator variables ff 
Starting from Y° =1',0,,Y=1',Z, we can directly Foams 
the following Horvitz- Thomson estimator in terms of the 
vector Z: 


> B ’ = 
Kee Lhe ze (2.5) 


Using the fact that Z=-O apX» Wwe have y? = 
1',T,11,'©,,Y and therefore we can define the column 
vector W of weights: 


W =0',,T, I, 1,. (2.6) 


The vector W is of size N* and for each i=1, ..., N’, 
we have w,=>",1464?/n4. The weights w, of that 
vector are said to be obtained fron the GWSM, as described 
by Lavallée (2002). 


3. Properties of the GWSM 


3.1 Unbiasedness 


As mentioned by Ernst (1989), to get an unbiased esti- 
mator, we only need to have E(W)=1,. By construction, 
because the estimator (2.5) is a Horvitz-Thompson estimator, 
this condition is directly satisfied and therefore, the GWSM 
produces unbiased estimates. 

From this discussion, we can in addition obtain the 
following result: 


Result 3: 


The vector of weights W_ given by (2.6) provides 
unbiased estimates if and only if the matrix ©,, is a 
standardized link matrix. 
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Proof: 
Starting from (2.6), we have 


E(W)=90',,1,. (3.1) 


Using Result 1, we directly get E(W) =1, and therefore 
we have unbiased estimates. Now, assume that E(W) = 1). 
From (3.1), we must have @',,1, =1, and therefore, O ,, 
is a standardized link matrix. 


3.2. Variance 


Because the estimator (2.5) is a Horvitz-Thompson 
estimator, we directly obtain the following result: 


Result 4: 
The variance of Y” is given by 


Var VO AZ 


=A, Y (3.2) 


where A, = [(x‘, = Ree WIG Te Ae is a non-negative 
definite matrix of size N“ x N“ and where 109 is the joint 
selection probability of units j and 7’ from U“, and 
where A, = 0',,A ,O 45. 

For a proof of the variance of the Horvitz-Thompson 
estimator, see Sarndal, Swensson and Wretman (1992). 


3.3 Transitivity 


Let us suppose that we are interested in producing 
estimates for a target population U© that can only be 
reached through the population U*. We assume that the 
target population U contains N° units, where each unit is 
labeled by the letter k. The correspondence between the 
two populations U? and U canbe represented by the link 
matrix @,. =[0/°] of size N® x N© where each element 
02° > 0. That is, unit i of U? is related to unit k of US 
provided that 0°° >0, otherwise the two units are not 
related to each other. 

We can now use Indirect Sampling by sransitivity. For 
this, we select a sample s* from the population U* and 
first identify the set Q° of U*. From this set Q’, we then 
identify the units of U“ that are associated in order to form 
the set Q° = {k EUS |5ieQ? and ae > 0} of units to be 
measured from the target population US. An important 
question is to see if the GWSM, when applied in the context 
of Indirect Sampling by transitivity, is also transitive. That 
is, is applying the GWSM from U* to U”, and then from 
U® to U, is equivalent to directly applying the GWSM 
from U4 to US? 

First, consider using Indirect Sampling from U% directly 
to the target population US. By going from the population 
U* to U”, and then to U, this can relate to having the 
link matrix © ,.=[0%¢ ] of size N4 = N° defined as © ,.= 
© ,;@,c. For each unit j selected in s“, we identify the 
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units k of U° that have a non-zero correspondence, i.e., 
with 0%; > 0, to obtain the set Q° = {k eU“ |Ajes* and 
0“ >0}. We measure the variable of interest y, from the 
target population US. Applying the GWSM, we obtain from 
(2.6) the following weights: 
WwW. md wavilyle, 

where © ,. = @ ,- [diag(1',@ ,.)] 

Let us now consider using Indirect Sampling in two 
steps. For each unit j selected in s“, we identify the units 
i of U” that have a non-zero correspondence, i.e., with 
0%” >0. As before, we have Q* = {ieU" |Ajes* and 
On > 0}. For each unit i of the set Q’, we then identify 
the units k of U° that have a non-zero correspondence, 
i.e., with 07° >0. We then have the set Q° = {ke 
US |53ieQ? and Oar >0}. From (2.6), we have the 
column vector W, of weights associated to the units of 
population U? : 


(3.3) 


W, =0',,T I, 1,. (3.4) 


For each unit i of the set Q?, we then have a non-zero 
weight w’. Now, the set Q’ can be seen as a sample of 
units that are used in an Indirect Sampling process to 
identify the set Q°. By similarity with Indirect Sampling 
from the sample s* to the target population U”, applying 
the GWSM in the context of Indirect Sampling from the set 
Q? to the target population U° produces the following 
weights: 


W, =0',. T; diag(W, )1, (3.5) 


where ©,. =@,,[ diag(1,@,.)] and T, =diag(t,) 
With) teat hese ste) band fei = | Gti Oleg ara a0 
otherwise. Because the weights w’ =0 for i¢Q’, we 


have T, diag(W, ) = diag(W, ). Therefore, we obtain 


W, =0',, diag(W, )1,- (3.6) 
Replacing W, by (3.4) in equation (3.6), we get 
W, = Oj diag(O!,, T, Wy 1,)1, 
=6',.6',,T, 0, 1,. (3.7) 


Since 0',.0',,1, =0',,.1,; =1,, from Result 1, the 
matrix © ,,@,, is a standardized link matrix. Because of 
this, the GWSM is therefore transitive, at least in some 
sense. That is, the weights W, can be obtained in a single 
step by using the standardized link matrix © ,,0,,- into the 
GWSM. Now, for the GWSM to be perfectly transitive, the 
weights W,. provided (3.7) would need to be exactly the 
same as the weights W, provided by (3.3). By comparing 
equations (3.3) and (3.7), we obtain the following result: 


Result 5: 


Applying the GWSM from U“* to U®, and then from 
U® to US, is transitive if and only if 
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© 4c a 0) ;05¢: (3.8) 
Unfortunately, condition (3.8) does not hold in general. 
In fact, it is relatively easy to construct examples where 


~ ~ 


© ic #9 4,9 50. 


4. A Structural Property of the GWSM 


In the present section, we stress the fact that with Indirect 
Sampling, the sampling process depends only on the links 
between the two populations U* and U*. The values of 
the oa themselves, apart from being zero or not, do not 
interfere in the sampling process. On the other hand, the 
values of the te do have a role in the weights, and 
therefore the estimator, issued from the GWSM. We extend 
this idea in the following paragraphs. 

Indirect Sampling associates to each sample s“ in U4 a 
sample Q? in U®, namely 9? ={icU? |Fjes* 
and OF > 0}. Thus, a function f:s4 — Q? that maps the 
sample s“ to the sample Q” is uniquely determined by the 
set of couples (j, i) with 6%" >0. Let 1° =1 if 047 >0, 
and 0 otherwise. These are the elements of the incidence 
matrix of the graph linking U* to U*. 

Suppose we are given a function from the set of 
subsets of U“ into the set of subsets of U”. Like /f, 
suppose that @_ satisfies the “Union Property”: 
o(s,1 Uist) ze (s,") Uo(sf ), Where Sia and MS are two 
subsets of U*. 


Result 6: 


The function is determined unequivocally by a zero- 
one link matrix. 


Proof: 


This can be shown as follows: Take Ce ={j} for some 
Minit pp male Then so sa)his avseb in, U.Let i, = Lat 
unit i of U* belongs to $(s/), and 0 otherwise. By the 
Union Property, $(s*) ree Grp and the set of Lie 
defines the zero-one link matrix L,, =[l hs ] of size 
N“ x N®, which precisely defines the function 9. 

This provides us an equivalence relation between link 
matrices, associated with a deeper property. Let p“* be a 
sampling design on U% (ie., a probability distribution on 
the set of subsets of U“). The function f induces a 
sampling design on U? by p?(Q*)= dy: evs De (s*). 
As the design is induced by f/f, it does not depend on the 
particular link matrix © ,, defining the function, but is 
rather a characteristic of the equivalence class through the 
zero-one link matrix L,,. As a consequence, the Horvitz- 
Thompson estimator in U® depends only on this class. It is 
therefore of some interest to choose in this class a matrix 
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© ,, having, in some sense, an optimal characteristic (see 
section 6). 


5. Special Link matrices 


As it can be seen from the previous sections, the link 
matrix © ,, drives the form of the estimator (2.4) obtained 
from the GWSM. In this section, we present some special 
link matrices ©,, that correspond to extreme cases. 
Although not all such cases are likely to be seen it practice, 
they illustrates the effect of the link matrix on the estimator 
(2.4). 


5.1 Identity Matrix 


Assume that the link matrix © ,, is given by the identity 
matrix I. In practice, this means that the population U“ 
and the target population U* have a one-to-one relation- 
ship. Of course, this implies that N“ = N? =WN and that 
the identity matrix I is of size Nx N. 

As a first result, we have © ,, =I. As a consequence, 
the vector of weights (2.6) is given by W' = (¢! bce A, 
t’, /™\,) and we also have Z=©,,Y = Y. Therefore, the 
estimator Y" given by (2.5) turns out to be nothing else 
than the Horvitz-Thompson estimator Y’ = 1',T,I1,'Y. 


5.2 One for All (Within Clusters) 


Consider the case where the population U” is divided 
into I clusters where each cluster y is of size N° . Theses 
clusters are such that each cluster y from U” is associated 
to exactly one unit 7 of U“. Because of this, we can use 
the letter y for both the units 7 from U% and the clusters 
from U*. Note also that T = N%. 

This situation corresponds to a link matrix ©,, being 
block diagonal where each submatrix contains only one line. 
Let the row vector 1}, be of size Ne and containing only 
1’s. The link matrix © ,, is then defined as 


Tees re calhasices 0 
(5.1) 

ie ik an 
We can also write ©,, =diag({1},, ..., Up }). Using 
this, we have diag(1',@ ,,) = diag(1’, diag({1',,, .... 14-})) = 
diag({1',,, .... 1,,}) and hence © ,, = ©. From equation 
(2.6), we obtain the column vector of weights W’= 
(t4 /mi1,, .» i / 4 1). As we can see, the elements of 


the column vector W_ have the values te / m7 repeated 
within each cluster y of U’. From (2.4), we obtain 
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r CHaiy 
Fae (5.2) 
y=l Ty 
where ve = eu We 
5.3 All for One (Within Clusters) 
Consider the case where the population U“ is divided 


into I’ clusters where each cluster y is of size Ny. Theses 
clusters are such that each cluster y from U“ is associated 
to exactly one unit i of U’. Because of this, we can use the 
letter y for both the clusters from U“ and the units i from 
U”. Note also that P = N’. 

This situation corresponds to a link matrix © ,, being 
block diagonal where each submatrix contains only one 
column. Let the column vector 1, be of size me and 
containing only 1’s. The link matrix © ,, is then defined as 


by 0-- 0 
0, =| 0 iy 0 (33) 
0. .t:n0 1 
We can also write @,, =diag({L,, ..., L,-}). Using 


this, we have © ,, = diag({1/N;*1,, .... 1/N¢1,-}). From 
see (2.6), we obtain the column yeeien of weights 

Wie (Nea | Sita Ne ar it /n*). Thus, the 
elements y (or 7) of the Bottini vector W fave the aver- 
aged values fe Lt, j Ny ,Y=1,.... T. From (2.4), we 
Oban ete eye Nay Aint, 


5.4 Inefficient Sampling 


Suppose that some rows of the link matrix © ,, contain 
only zeros. This means that some units of the population 
U* are not associated to any unit of the target population 
U*. Then, if such units are selected in the sample s“, this 
will lead to the identification of no unit from U*. This can 
be seen as inefficient in a sampling point of view. In a more 
formal way, assume that each of the first N'“ rows of the 
link matrix © ,, contains at least one 0, > 0, and that they 
form the submatrix ©,. Assume that the other N°“ rows of 
© ,, have 0,,=0 for i=], ..., N*. We therefore have 


As a first result, we obtain 


5 _| Oldiag(1;,,)T" |_| 9, (5.4) 
| 0 0 | 


oF 
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where 1,, is the column vector of 1’s of size N'*. From 
equation (2.6), we obtain the column vector of weights 
W =[6; 017,11, 1,. Let 1, =diag({ny, ..., m.}) be 
the diagonal matrix of size N'“ x N'“ and accordingly, let 

Tyjadiag (trees tuny) be the diagonal matrix of size 
N'“ x N'4. We then get 


W =[0 0'JT,11, 


= OT, Waly. (5.5) 


As we can see from (5. >), the weights only depend on the 
probabilities of selection 1 of the units of U“ that have at 
least one 0,,>0 for i= id , N”®. From (2.4), we finally 
obtain Y” = 1,7 ,116,Y. 


5.5 Biased Estimator 


Suppose that some columns of the link matrix 0, 
contain only zeros. This means that some units of the 
population U® are not associated to any unit of the target 
population U~. Recall that in order for the matrix © ,, to 
be well defined, we must have diag(1',O,,) | to exist. As 
we will see, the present case does not satisfy this condition. 
This results in a biased estimator for the total Y”. 

In a more formal way, assume that each of the first NV” 
columns of the link matrix ©,, contains at least one 
0, >0, and let them form the submatrix ©,, different 
from the one of the previous section. Assume that the other 


N°* columns of © ,, have 6,,=0 for j=1, .... N*. We 
therefore have © ,, =[O,, 0]. 
From this definition, we directly have 
[diag(1’,O ,,)] | =[diag((1’,0,,1,0)] 
a 
diag(1',0,) 0 
= g(1,0,) (5.6) 
0 0 
Since this matrix is singular, [diag(1',O ,,)] does not 


exist. As a solution to this problem, it could be possible to 
use a generalized inverse. Recall that for a given square 
matrix A, the matrix A’ is a generalized inverse of A 
provided that AA -A=A _ (Searle 1971). One possible 
generalized inverse of (5.6) is 


[diag(1’,0,)}" 4 
4 


[diag(1’,0,,)] = ‘ 


(5.7) 


With this generalized inverse, we have the following 
standardized link matrix ©_=@,, [diag(1',0,,)] = 


[O, ,0]. Starting from equation (2.6), we can obtain the 
column vector W_ of weights: 
I —l 
w= pert a (5.8) 
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As we can see from (5.8), the weights are null for the 
units i of the target population U* that © ,, have 0,, =0 
for j=1, ..., N*. From e 4) and using W_ instead oe Ww, 
we ean pp =1,T,1'0,Y, where Y, ={y,..., Vy} 
is the subvector constructed from the N’” first elements of 
Y. Since in general E(¥’)=1',0,Y,41',Y=Y", this 
estimator is biased for the total Y”. 


6. Optimality 


Optimality is an important aspect of the GWSM. As it 
has been shown in Result 3, the estimator Y’ obtained by 
the GWSM will provide unbiased estimates provided that 
the matrix © ,, is a standardized link matrix. Now, given 
that the variance (3.2) of this estimator depends on this 
matrix, there should be at least one matrix © , Bop: Such that 
the variance of the estimator Y? will be minimum. That is, 
for the os that are greater than 0, we are interested in 
finding the values that these Ory should have to obtain the 
most precise estimator Wae 

This optimality problem was first assessed by Kalton and 
Brick (1995). They obtained results based on the simplified 
situation where N“=2 and with s* obtained through 
equal probability sampling. Their conclusions suggested the 
use of Oks lene Os =U and Oa 2 =U when 
6“ =0. Lavallée (2002) and Lavallée and Caron (2001) 
obtained results along the same lines by the use of 
simulations. In the present section, we present new results 
on the optimality of the GWSM. 


6.1 Factorization 


Factorization is the reverse problem of transitivity. It 
consists in finding a population U° and standardized link 
matrices ©, and @,, such that O,,=0,,0,,. This 
leads to an important simplification in searching for an 
optimal standardized link matrix © , Boks 

The population U° can be taken as being one of 
clusters, the factorization being achieved in the context of 
“one for all (within clusters)” (from U“* to U°) and “all 
for one (within clusters)” (from U° to U*), as presented in 
sections 5.2 and 5.3. This can be described in a very general 
way as follows. Consider a population U° containing as 
many units as there are links starting from the units j of 
U*. The population size N° is then given by the number 
of 0%" of @,, that are greater than 0. Each unit g of U° 
can be seen as the extremity of an “arrow” starting from 
some unit 7 of U*. From this graph, there is only one link 
matrix @,, of size N*xN° keeping unbiasedness, 
gamely Ox es (e “1 where chee =1 if there is a link Ao an 

“arrow’) leaving a i LOL U’ to unit g from U’, and 
64° —(0 otherwise. Note that by construction, each ftp g 
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from U® is linked to at most one unit j from U* and 
therefore © ,, =©,,. This corresponds to the “one to all 


within clusters” situation presented in section 5.2. Indirect 
Sampling from U* to U® is in fact standard Cluster 
Sampling and leading the GWSM to the usual Horvitz- 
Thompson estimator (see Lavallée 2002). For the parent- 
children example, the result of this factorization would be 
given by Figure 2. 


via) 
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sy / 
ons. 
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KO 460s SG, OA 
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© 
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— 
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Figure 2. Result of the factorization of the parents-children 
populations. 


Considering the graph from U° to U’, we can 
construct the link matrix ©, of size N° x N” as follows. 
Because of the definition of the population U°, each unit 
g of U® is linked to exactly one unit i of U”’. Note that 
Indirect Sampling in this context can be seen as sampling 
clusters (i.e., the units i of U”) from their elements (ie., 
the units g of U%). It can also be seen as the “all to one 
within clusters” presented in section 5.3. Let O,, = 
O,,,[diag1, 9, )]' be the standardized link matrix ob- 
tained from ©,,. We have diag(1,@,,) = diag(1',© ,,), 
and therefore O,, =@,,[diag(1', 9 ,, ye. 

Now, 


© 96s 
=0,, oO¢s(diag(l, O.; Vita 
0) 


gpl diag(1’, © 4, ie 
(6.1) 


Therefore, using this construction, the standardized link 


matrix © ,, from U“ to U” can always be factorized into 
the two matrices © ,, and O¢p. 
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6.2 Strong Optimality: Statement of the Problem 


As mentioned before, the optimality problem that we 
consider here is to minimize the variance (3.2) with respect 
to the standardized link matrix ©,,. Now, using the 
factorization presented in section 6.1, we have 


Var(Y") = Y'O',,A ,O ypY 
= ¥'O6,0 4c 19 sc cn 
= Y'OG,AGOceY 


where A, = 0',,A ,9 jc 

For any standardized link matrix © ,,, the factorization 
presented in section 6.1 always produces the same first 
factor © ,,. Therefore, if we seek for some optimal matrix 
© 4; 0 that minimizes the variance (3.2), it is sufficient to 
optimize the second factor @,,. We would also like the 
optimal matrix © , B,opt tO produce unbiased estimates. 

Let U’ be the subpopulation of U% containing the N’ 
links to the unit i of U”. Note that the subpopulations U . 
are disjoint. Thus, without loss of generality, we can order 
the links from U* to U® so that, for every i, the links to 
unit i in U” are indexed consecutively. Now, let 0,,, be 
the i" column vector of the matrix ©,,, i=1, ..., N’. By 
construction, the vector 0,,, contains non null elements 
only for the Ne links to the unit i of U*. Hence, letting 
en ; be a column vector of size N. ° containing the non 
null elements of 6,, ;, we have 


(6.2) 


Similarly, let 1,, be the column vector of size N° 
containing 1’s for N? elements, and 0’s elsewhere. Letting 


1, be a column vector of size N° containing 1’s, we 
have 


S § 


Now, for the GWSM from U° to U® to be unbiased, we 
need to have 6,,,1,,;=1 for all i, or equivalently 
0/,, 4g; =1. All this together leads to the following opti- 
mization problem: : ‘ 

Find a matrix O65 op = (9 ep, oper += fe oe) Satis- 
fying 96 oit¢; =! for all i =1, ..., N®, and minimizing 
the quadratic form Var(Y") = Y'O1,,A,OGpY. 

This problem turns out to be nothing else than the 
minimization of a positive quadratic form under linear 
constraints. This is a relatively standard and simple problem 
to solve. It is well known that a solution always exists and is 
unique if the form (6.2) is positive definite, or if the null 
subspace of @,,, is not included in the null-space of Ag. 
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The above optimization problem can be rewritten in a 
different form. Let A, ;, be the submatrix of A, 
corresponding to the elements in positions g and g’ if g 
has a link with unit i and g’ has a link with unit 7’. These 
matrices constitute a partition of A,. Note that the matrices 
A; ;; are symmetric, positive definite, and AG jv =Ag i. 
With these notations, the optimization problem can be 
written as: 

Minimize 

ne Ne 


S SS y; ¥Oay iAg. por i! 


jel y= 


(6.3) 


under the constraints 64, 1, , =1 forall i=1, ..., N”. 


Minimization is achieved for vectors 0, .»,; Satisfying 


NB 
yp Ae i 9 Gp, Rid ANG; 


v=) 


(6.4) 


for all i=1,...,.N”° and where 2, are the Lagrange 
multipliers entering into the constrained minimization of 
(6.3). As we can see from (6.4), the optimal choice 65 651; 
(and therefore @¢, ,,,) will depend in general explicitly on 
the vector Y, which is not useful in practice. Observe that 
the set of 1, depends also of the variable Y. This will appear 
more explicitly in section 6.3. This is the reason why we will 
seek, instead of a strong optimization, for a weaker form of 
optimality that will lead to the existence of an “optimal” 
solution O62 opt (and © ,, opt) Not depending on Y. 


6.3 Weak Optimality 


Equations (6.4) must be valid for any vector Y. In 
particular, a necessary condition is to hold for a particular 
variable of interest, such as y, =1 fora unit i of U’ and 
y, =0 for all other units i’ of U® (i' #7). This leads to the 
necessary conditions (one for each of those particular 
variables) Ag :9¢p.op.; =AAc; Assuming that Ag, is 
invertible, we then have 6,, we =AA Age sk eatleDe 
shown that this is also a sufficient condition. Now, because 
Oe ociliag = L. we haves ais 1, Ay 1c pl nereroresa 
necessary and sufficient condition for equation (6.4) to be 
satisfied is when 


=i 
6 a Ag iki 
GB, opi Say 5} ’ 
1, Agile: 


(6.5) 


1 


This result corresponds to weak optimization in the 
following sense. The weight w, given by (2.6) satisfies 
E(w,)=1 and moreover E(w, |i¢Q’)=1/n? where 1? 
is the inclusion probability of unit i in Q”’, which is 
generally difficult or even impossible to compute in practice. 
Now, note that the Horvitz-Thompson estimator is charac- 
terized by Var(w,|ieQ’)=0. The weak optimization 
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obtained here consists in minimizing Var(w, |i € Q?) over 
all possible standardized link matrices ©,,, or equivalently 
© ,;. This variance is strictly positive for the cases where 
unit i of U” is in position to receive more than a unique 
weight for different sample s*. Moreover, using (6.3), the 
multiplier 2, appears to be the variance of the weight w, 
and is, therefore, always strictly positive (except, a case that 
we exclude, when unit 7 is selected with a weight equal to 


one). 


6.4 Strong Optimality Independent of Y 


Weak optimality is a necessary condition for strong 
optimality independent of the vector Y of a variable of 
interest. It provides the necessary form of the vectors 
er opti I (6.4). To get sufficient conditions for strong 
optimality independent of Y, we go back to the equations 
(6.4). These equations need to be satisfied for all vectors Y 
and they must therefore be satisfied for a particular variable 
of interest such as y, =1 for a unit i of U’, y, =1 for 
another unit i’ of U’, and y,,=0 for all other units i” of 
U® (i"#i' #7). In that case, to satisfy equations (6.4), it is 
necessary to have the following relations for any i and i’: 


AG 9 + Ag vee, opt’ = HP Ne, (6.6) 


GB, opt, i 


~ 


ws, $i ii! 
Ag 1% Ge, opt, 7’ ui Ag ii 9 Gp, opti hi 1, 


As we must necessarily have weak optimality, we have 
Ag 20%, opt? = 41g; Considering the first line of (6.6), we 
then get 


~ in ii’ a 
AG i GB, Opt\7 (A; A Mg; 


Sete (6.7) 


Multiplying both sides of (6.7) by 8/5 op. 5, We obtain 
OGn opt, iAg. ii 9Gz, opt, i’ = D865 opt, i va i 


= QD, 


since Oop. optitgi =1. Let ® be the matrix with elements 
®,, off the diagonal and ®,, =A, on the diagonal. Using 
again (6.2), it can be shown that the optimal variance 
(whenever it exists) has the expression Y'®Y. 

Let us show that this set of conditions is also sufficient. 
Assume that (6.7) holds. Note that for i = 7’, condition (6.7) 
is nothing else than (6.5) which gives the necessary values 
for the 6.5 opti: It is now straightforward to verify that (6.4) 
holds whatever the value of Y and that we have obtained 
the strong optimality. Now, the values of 1, depend on Y, 
as well as the variance Var(Y"), but we have that 
equations (6.4) always have the same solution (6.5) that 
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does not depend on Y. We therefore have the following 
result: 


Result 7: 


The conditions Ag ZO =@,1¢; are necessary 
and sufficient for the existence of a standardized link matrix 
Oz opt? OF equivalently Oy; op» that achieves strong 
optimality independent of the vector Y of the variable of 
interest. The values in the columns of this strong optimal 
matrix are given by (6.5), which are the vectors 0 
obtained from weak optimality. 

It should be noted that since Ag ;,O¢, opti = AAG; (6.7) 
can be written in an equivalent way as 


GB, opt, i 


©; Ou, opt, i 4 AE Ae 50 Ree i' (6.8a) 

or 
®;, 1G; = i thenl Ve rth bag, (6.8b) 
where ®;, = Ce opt ie. nOGE opt i N(1e SAR wig ;) and 


* ar ' —1 
Di, = (06 opt AG i Gp, opt, Ag AG lg. »)- In some 
situations, these can proved to be easier to use that the 
expresssion (6.7) stated in Result 7. 


6.5 Two Examples 


We now present two examples that illustrate the 
preceding theory on weak optimality and strong optimality 
independent of Y. 


Example 1: Poisson Sampling 


Let us suppose that the sample s“ is selected using 
Bernoulli or Poisson Sampling. In that case, the N“ x N4 
matrix A, is given by A, =diag(I/7* —1). Considering 
the factorization of section 6.1, we have A,= 
O16 44 94g = Og [diag(l/n; -1)] © 4g =[diag((I/ 1; - 
1)1,,;)] where 1, ,, is a square matrix of size N7, with 
N 7 being the number of links (or “arrows’’) starting from 
unit 7 of U*. From Ag, we extract the submatrices Ag ; 
that are, in the present case, diagonal. Each submatrix A, ;; 
is given by A; ; = diag(1/n? —1), which is of size N’. 
Note that each value (1/ Te —1) simply corresponds to a 
unit 7 of U% that has previously been linked to the unit g 
of U°, which is in turn linked to the unit i of U?. Now, 
from (6.5), we directly obtain the optimal values 6,, oes 
that minimize Var(Y”), in the weak sense. These values 
are given by the vectors 
A 
Ne 


(l—n)th abl (l= myo) ty 


A TU 
ES Ty 


GB, opti me 


where 
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10 Sy ne ae i Ne 


The 6/5 opti are used to construct the vectors O15 opty» and 
then the matrix O, opt = 20 ETS vy 0 GB, opt, N" oj. Finally, 
after computing the optimal matrix © 4s 4. = 9449 Ge op» 
we obtain the optimal weights W,,, using (2.6). 

It should be noted that if the inclusion probabilities Th 
are equal, we get 


a 1 l 1 
862 opti =|. sees sorte 


where N° is nothing else than the number of units of U4 
linked to unit i of U*. In other words, in the context of 
Bernoulli Sampling (ie., Poisson Sampling with equal 
probabilities), to minimize the variance Var(Y”), the 
choice of the values og ji Should be given by | if there is a 
link between unit j of U4 and i of U’, and 0 otherwise. 
This corresponds to the results obtained by Kalton and 
Brick (1995), Lavallée (2002), and Lavallée and Caron 
(2001). 

Using Result 7, we now verify if conditions (6.7), (6.84) 
or (6.8b) are satisfied for the optimal matrix © ,, opt that we 
obtained through weak optimization. If it is the case, this 
matrix also provides strong optimality independent of the 
variable of interest y,. First, we have 


A 
To 
ieee ~ sie 7} 
l-n% 


Also, each submatrix Ag ,, of size NV” x N,’ has somewhat 
a diagonal structure, but “padded” with zeros. That is, a 
typical element of A, ,, is given by (1/ me —1l) ona part of 
the diagonal if both i and i’ are linked to the same unit 7 
of U% (that is linked to unit g of U° coming from the 
same j of U“), and 0 otherwise. Because of this, if two 
units i and i’ are not linked to the same units of U“, then 
Ag ; 1S a matrix of zeros, and then the conditions (6.7), 
(6.8a) and (6.8b) are automatically satisfied. Referring to 
Figure 1, children i =2 and i’ =3 of U® are not related to 
the same parents 7 of U“. If the selection of the parents is 
done using Poisson or Bernoulli Sampling, the 2 x 2 matrix 
Ag >; will then contain only zeros, i.e., 


>a [i040 
Ce Rt 8 14 


Because if this, the relations (6.7), (6.8a) or (6.8b) will be 
satisfied with ®,, =0, expressing the fact that the weights 
of i and 7’ are not correlated. 

If two units 7 and i’ are linked to the same unit j of 
U“*, then, using (6. ?), the on vee Ag . Oe opt i 
contains the scalar (x2 Nas =r me mites my for its first 


Statistics Canada, Catalogue No. 12-001-XPB 


Deville and Lavallée: Indirect Sampling: 


The Foundations of the Generalized Weight Share Method 


N? compSnENss and 0 for the remaining N? -N? ones 
(assuming N;’ > N.’). Because the quantity Ae J Oey abil 
must be equal to ®,, 1g; to satisfy (6.7), it must contain 
only the value ,,,. Sines Dine Ope Ad 1 Od, Wy ppithis 
will occur only if the vector ie opel =a which means 
that there is only one link to unit i of U’. As we can see, 
this is not a condition that will be satisfied in general and 
therefore, it can be said that in the case of Poisson Sam- 
pling, strong optimality independent from Y will not occur 
in general. 

As a conclusion, we might say that with Poisson or 
Bernoulli Sampling, the conditions (6.7), (6.8a) or (6.8b) 
will be satisfied in practice only when the units of U* are 
linked to a single unit of U*, as in the case of sampling 
households using a frame of individuals. In the other cases, 
the optimal matrix 0, Bopt Obtained through weak 
optimality will not likely lead to strong optimization 
independent of Y. 


Example 2: Simple Random Sampling 


Let us suppose that the sample s* is selected using 
Simple Random Sampling. In that case, the Nx N“ 
matrix A, is given by 


aiid ated 1, | 
See ON a) yey) 


Considering the factorization of section 6.1, we have 


Ag = 0',A 9 ic 


= Be alos: Sa n’) x @' 1,-+ i 
Tau) oe Wek 
N4 (N4—-n*) ris ue 
= Ww (N*aD diag(1, ,, (6.9) 
where 1, , is a square matrix of size N a with N e being 


the number of links (or “‘arrows’’) starting from unit 7 of 
U*. From Ag, we extract the submatrices Ag ;. Each 
submatrix Ag ,, 1s given by 


LNA 4 =n4), 
Ww UNOS 


which is of size N’. Then, using a matrix result that can be 
found, amongst others, in Jazwinski (1970), we get 


l 
x Et aa latas | 


Now, from (6.5), we directly obtain the optimal values 


Ls pina Neo aldyaibe 
AG ii = A Ay y74 
(N% —n*) N 


1 


We a 


O23, opt, 7 a 
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that minimize Var(Y”), in the weak sense, ad Spee No 
These values are used to construct the vectors O15 ep oud 
then the matrix O,, opt = = {on opt? “9 ee aie oj. Finally, 
after computing the optimal matrix © jp... = 9469 6x op 
we obtain the optimal weights W,,, using (2.6). 

Again, this result is an important one because it goes 
directly in the direction of the results of Kalton and Brick 
(1995), Lavallée (2002), and Lavallée and Caron (2001). 
That is, with Simple Random Sampling, the optimal choice 


of Ose ji Should be | if there is a link between unit j of 
U* and i of U”, and 0 otherwise. 


Using Result 7, we now verify if the conditions (6.7), 
(6.8a) or (6.8b) for strong optimality independent of y, are 
satisfied for the optimal matrix ©, opt that we obtain 
through weak optimization. First, each submatrix A, ,, of 


size N° x Ne is given by 
(NV ) Lele; 
A x| H - 
G, ii A (N4 tin 1) G, ii N4 


where H, ; is a N° xN¢ diagonal matrix of ones, 
“padded” with zeros. Exactly on the same pattern as in 
example 1, a typical element of H, ;, is given by | if both 
i and i’ are linked to the same unit j of U% (that is linked 
to unit g of U °), and 0 otherwise. Therefore, we can 
easily see in which cases the conditions (6.7), (6.8a) or 
(6.8b) can be satisfied. In fact, because all components of 
Oy op, are equal, Ag ;; Ob opt,’ 18 a vector proportional to 
the sum of the lines of Ag ;;, ie., the sum of the lines of 


Ie lev 
Hh = A | 
N 


But (6.7) says that this vector must have the same 
components. This is possible if and only if the matrix Hg ji 
contains only zeros, or if it is of dimension 1x1, which 
occurs when both 7 and i’ are each linked to only one 
element of U“. Therefore, as for Poisson Sampling, strong 
optimality independent of Y does not occur in general for 
Simple Random Sampling. 


7. Conclusion 


In the present paper, we discussed the use of Indirect 
Sampling together with the method developed to obtained 
estimation weights: the Generalized Weight Share Method 
(GWSM). We then showed the following properties of the 
GWSM: unbiasedness, the variance computation and 
transitivity. We presented after a section on the use of the 
GWSM when the links between the populations U“* and 
U® are expressed by ones and zeros, i.e., there is a link or 
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there is not. The section after was devoted to results that are 
obtained with different forms of link matrices. Finally, we 
assessed the problem of optimality, i.e., the choice of optimal 
values to express the links between U* and U”® in order to 
minimize the variance of the estimates issued from the 
GWSM. We have distinguished two kind of optimization: 
weak and strong optimization. 

Weak optimization consists in finding the values of the 
links to be used in order to minimize, for each unit, the 
variance of the weights provided by the GWSM. The 
solution is always uniquely defined, easy to compute and to 
implement in practice. Weak optimization is also a necessary 
condition for strong optimization. Strong optimization 
consists in finding the values of the links in order to 
minimize the variance of estimation for the total of any 
variable of interest y. It does not exist for all sampling 
designs and type of links between the populations U* and 
U®. It also depends on somewhat complicated relations. 

We recommend the use of weak optimization because of 
its flows naturally and the fact that it is very easy to use. 
Moreover, if our estimation problem can be as well 
optimized in the strong sense, we will have achieved it 
through weak optimization, even if it was not demonstrated! 
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Extension of the Indirect Sampling Method and its Application to Tourism 


Jean-Claude Deville and Myriam Maumy-Bertrand ' 


Abstract 


A survey of tourist visits originating intra and extra-region in Brittany was needed. For concrete material reasons, “border 
surveys” could no longer be used. The major problem is the lack of a sampling frame that allows for direct contact with 
tourists. This problem was addressed by applying the indirect sampling method, the weighting for which is obtained using 
the generalized weight share method developed recently by Lavallée (1995), Lavallée (2002), Deville (1999) and also 
presented recently in Lavallée and Caron (2001). This article shows how to adapt the method to the survey. A number of 
extensions are required. One of the extensions, designed to estimate the total of a population from which a Bernouilli sample 


has been taken, will be developed. 


Key Words: Generalized weight share method; Incomplete frame and multiple frames. 


1. Introduction 


A “border survey” of extra-region tourist visits in 
Brittany (those not by residents of Brittany) was conducted 
over the period from April to September 1997. The 
Observatoire Régional du Tourisme de Bretagne and the 
Comités Départementaux de Tourisme were interested in 
doing another one. Unfortunately, they no longer had the 
means to gather a certain mass of data at the regional or 
intra-regional borders because the police forces were no 
longer interested in collaborating on roadside surveys. 

For this reason, the Observatoire Régional du Tourisme 
de Bretagne, with the assistance of a technical committee 
comprised of methodologists and field operators, decided to 
introduce a new survey methodology to replace the “border 
survey” methodology. In addition, evaluation of intra- 
regional tourism (of residents of Brittany vacationing in 
Brittany, for example) is vital to identifying development 
factors. 

One of the major problems is the lack of a sampling 
frame that allows direct communication with tourists. This 
problem was addressed by using an approach previously 
used in the Asturias in Spain (Valdés, De La Ballina, Aza, 
Loredo, Torres, Estébanez, Dominguez and Del Valle 
(2001) and Torres Manzanera, Sustacha Melijosa, 
Menéndez Estébanez and Valdés Peladez (2002)), which 
involves sampling services intended mainly for tourists and 
asking them questions at the various locations of these many 
tourist service sites. Obviously, a tourist may use one or 
more of the services in the sampling frame once or several 
times during the survey period in question. To be able to 
estimate the parameters of interest with respect to tourists, it 
must be possible to conduct a rigorous sample of certain 
services and then link the set of weights of the sampled 


services to the set of weights of the tourists the tourists who 
used these services. The purpose of this article is to present 
a method that makes this calculation possible. This method 
relies mainly on the generalized weight share method 
(GWSM) developed by Lavallée (1995), Lavallée (2002) 
and Deville (1999). 


2. Generalized Weight Share Method 


We will briefly review the principle of the generalized 
weight share method (GWSM). For more information, see 
Lavallée (1995), Lavallée (2002) and Deville (1999). 

We will let U* be a finite population containing N“ 
units, where each unit is denoted by j and U” isa finite 
population containing N” units, where each unit is denoted 
by i. The correspondence between U* and U” can be 
represented by a matrix of links ©,, = 18 «al of size 
N“4 x .N®* where each element Oe >0. In other words, the 
unit j of U% is linked to unit i of U’ provided that 
ee >0; otherwise, there is no link between these two 
units. 

In the case of the indirect survey, we select the sample 
s* of n* units from U* based on a given sampling 
design. Let mv >0, be the probability of selection of the 
unit 7. For each unit 7 selected in s*, we identify the units 
i of U® for which OF >0. Then we let s?, be all of the 
n® units of U? identified using the units j € s*, that is, 


s® = {ieU";4jes* and Oo, > U. 


For each unit i of s”, a variable of interest y, is 
measured. 

It is assumed that, for any unit 7 of s“, it is possible to 
obtain the values of Oa for i=1,..., N’ by a direct 
interview or from an administrative source. For any unit i 
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identified of U? (or only of s”), it is assumed that we can 
obtain the values of 0“ for We lay 4’ For this reason, 
it is not necessary to know the values of Bi for all of the 
matrix of links @,,. Indeed, we only need to know the 
values of 04” for lines j of ©,,, where jes“, and for 
columns i of @ ,, where ies”. 

For example, if the purpose is to estimate a variable of 
interest Y” of target population U’, where 


Nn 
ere Days 
i=l 


with y, measured according to the aggregate U”. We then 
use an estimator in the form 


ne 

COTE 

Y = Wp 
i=] 


(2.1) 


On) 


where w, is the estimated weight of unit i of s’, with 
w,=0 for i¢s*. To obtain an unbiased estimate of a 
variable of interest Y”, we must use as weight w, the 
inverse of the probability of selection nt of unit i. As 
mentioned in Lavallée (1995) and Lavallée (2002), it is 
generally difficult, if not impossible, to obtain these 
probabilities. Consequently, we turn to the GWSM, where 
the weights are given by 


A 


where ee = pe ee, Gi Using this construction, the 
estimator Y? is unbiased. Similarly, it is possible to 
calculate and estimate the variance of this estimator because 
it is the same as that of 

Z 


tg 
A ) 
jest 1; 


with z, = ae Oy y 


it 


3. Tourism Survey in an Open Environment 


3.1 Survey Objectives 


The principle of the survey is as follows: 
“reach tourists (foreigners or French citizens 
whether or not they live in Brittany) through services 
aimed at meeting the basic or specific needs” 
such as accommodation, food, leisure activities and 
transportation. 


3.2 Population of Interest 


We will let G be a geographic field (the four provinces 
of Brittany) and P be a reference period (in this case, it is 
from February 2005 to December 2005). 
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A tourist is defined as a person who spent at least one 
night in G outside his principle residence (tourist-night). 

For a tourist, a trip is an period sej of P, the length of 
the cardinal of sej noted as | sej |, during which the tourist 
spends all his nights in G outside his principle residence, 
the nights immediately before or after the trip sej having 
been spent outside G (or at the principle residence.). 

A tour is a group of tourists (tourist household) sharing 
the same trip and with the same accommodation during the 
trip. The term tourist household will also be used through a 
slight misuse of the terminology (the same tourist household 
can have several tours over a period, but we have no way to 
distinguish them). 

The statistical unit i of the survey is the tour. 

The sub-units of the survey are the trips, tourists and 
tourist-nights. A tour i consists of , tourists during a trip 
of duration | sej| and thus n, x | sej| tourist-mights. Here 
population U” is therefore the aggregate of the tours in G 
during P. (sej 0 P# ©). 


3.3 Survey Sampling Design 


To use the GWSM, the theoretical population U* is 
formed by a “services” aggregate. In this survey, these 
services consist of: 


— Purchases in bakeries, being the first stratum of U“. 

— Visits to a set of well known cultural, recreational or 
family sites. In practice, for each of them, a 
“mandatory pass point” has been defined. It consists 
of the total number of people passing by this point, 
which is the second stratum of U%. 

— The number of people exiting Brittany by way of the 
La Gravelle highway toll, which accounts for 80% of 
the exits by tourists from Brittany by car. This 
method of transport itself accounts for 80% of the 
trips by non-resident of Brittany. People passing this 
point constitute the third stratum of U“. 


In other words, the sampling frame is formally 
constructed of three strata: 


1. purchases in bakeries; 
2. visits to a set of sites typical of Brittany; 
3. people at the La Gravelle highway toll. 


In the first stratum, we use a three-stage sample: 


— asample of bakeries; 
— asample of survey days; 
— asample of clients in the bakery on a given day. 


In the second stratum, we use a two-stage sample: 


— asample of survey days; 
— a sample of people who pass through one of the 16 
chosen sites on a given day. 
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Lastly, in the third stratum, we use a two-stage sample: 


— asample of survey days; 
— asample of people who pass through the La Gravelle 
highway toll on a given day. 


It is acknowledged that any tourist household consumes 
at least one of the “services” (bakery purchases, visits to 
typical Brittany sites, the La Gravelle highway toll)), or at 
least, that very few households do not consume any of them. 

Each sampling (bakery, days, “‘service’”’) requires specific 
techniques and it would take considerable time to provide 
details on each of them. Nevertheless, we will provide the 
following key technical elements: 


— bakeries are sampled using a traditional design 
stratified geographically (five strata: coastal area of 
four Brittany departments, the interior of Brittany). 
In each stratum, the bakeries are sampled with 
probabilities proportional to their “tourist potential” 
constructed from their business revenue, the tourist 
accommodation capacity, and the number of prince- 
pal residences in the commune to which they belong. 
This was the theoretical approach, but in practice, 
the sample was somewhat “forced” by unforeseen 
circumstances (refusal of bakers, closures during 
certain period, for example). 

— The sites are not sampled, but rather selected for 
their notoriety and the technical possibility of 
identifying a “mandatory pass point’ (sometimes 
approximate). 

— For each bakery, each site and the La Gravelle 
highway toll, we defined completely homogeneous 
“clusters of days” in each period P. A cluster was 
assigned randomly to each bakery, site and the La 
Gravelle highway toll. In practice, this means that a 
full-time enumerator is mobilized for several 
clusters. 

— For each “service”, tourists are sampled using the 
normal techniques of random selection of arrivals: 
pseudo-systematic sample because, while the 
enumerator is handing out one questionnaire, other 
people are going by without being counted. This 
means that the total number of visitors cannot be 
estimated directly. If a site is accessible through a 
ticket booth (museum or chateau, for example), the 
sampling relies on this means. Ultimately, the 
sample of users of a “service” on a given day is 
considered a Bernouilli sample, that is, a simple 
random sample if we know the size of the population 
(the number of visitors on a given day). 


Comments 3.1. The definition of ‘ourist itself is linked to 
accommodation and it seems natural to use a frame directly 
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related to this service. Practice shows that this is difficult to 
achieve. 


To begin with, there is no correct sampling frame for 
non-commercial accommodation (relatives, friends, second- 
ary residence) or for seasonal furnished rentals. 

In the case of hotels, campgrounds and family holiday 
homes, the trials runs in summer 2004 revealed the 
existence of catastrophic bias due to the intervention of hotel 
owners in the survey selection process. The hoteliers did not 
respect the random sample instructions and “essentially” 
distributed the questionnaires to their best clients. This part 
of the survey had to be set aside and replaced by the count 
through the La Gravelle highway toll, which is regularly 
subject to honest quality surveys by various organizations. 

The questionnaires collected at the bakeries and at the 
Brittany tourism sites during summer 2004 apparently 
produced good qualitative and quantitative results regarding 
the various modes of accommodation. 

Food consumption would undoubtedly have been cap- 
tured better by questionnaires at the exit of supermarkets, 
but the problem there lies in the heterogeneity of these 
establishments and in the cutthroat competition between 
them; group C ... agrees to the surveys in its establishments 
only if group / ... is excluded! In contrast, the collaboration 
of local bakers in the survey was excellent. 


Comments 3.2. By the very definition of the method used, 
we operate formally within the context of sampling from 
multiple frames. The problem has given rise to considerable 
literature (Hartley (1962), Lund (1968) and Hartley (1974) 
for a start). The GWSM applies to this problem by simply 
considering each sampling frame as a stratum provided that 
it is possible to identify for each unit sampled all of frames 
of which it is a part. This approach provides a rigorous and 
unique design-based solution to this problem. This comment 
is worthy of its own article, but the authors know that it is 
not worth the trouble: an idea that can be explained in ten 
lines does not need an article or a book for it to survive. 


4. Parameters of Interest 


Application F’, which links to any service 7 during the 
reference period P in the three types of establishments of 
the survey coverage tour i that used this service, is defined 
as: 


F :services —> tour 


J a Dae 


We will let U’, be the population of tours i of reference 
period P. This population of interest U’ is the image by 
F’ of the aggregate of services during reference period P 
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in the three types of establishments of the survey coverage. 
Population U“ is the image by F' of the aggregate of 
tours during reference period P. For all ic U*, we define 
R.(B) = card(F'(i)), the number of antecedents of i 
during the survey period, that is, the number of services / 
used by the given tourist household i . 

The parameters of interest can be totals, sizes or ratios. 
Let us assume, for example, that we are interested in the 
estimate of a total relative to a variable y defined on 


population U”, 
Yy* = ve he 


icU? 


(4.1) 


A specific example of these totals is the size of U’, 

written N” and defined by 
N? = card(U”) = De di: 
icU? 

For example, Y® can be the number of people who 
practiced this activity, the total budget spent by the tourist 
household in Brittany, the geographic origin of the tourist 
households, or the number of days that the tourist household 
spends in Brittany. It should be noted that for many 
variables, the total Y’ depends on the size of the tourist 
household, that is, the number of people who make up this 
group and on the length of the trip (only those days spent in 
Brittany). 

Now, we can write 


3 
Meith? yer Duels idles etter Zh ovina 2) 
icU® l=1 aed, deD, jeCy 
where 
J; ‘ Eee 
z,=———,, for jeF (i), 
RB # (i) 
where 


— A,: the aggregate of bakeries in the survey 
coverage identified by index a, 

— A,: the 16 visit locations in the survey coverage 
identified by index a, 


— A,: the La Gravelle highway toll identified by 
index a, 
— D,: the aggregate of survey days, identified by 


index d, in an establishment a, of A,, for the 
variant of | to 3 

— C,, :the aggregate of services in an establishment a, 
of A, of day d, of D, identified by index /. 


5. Unbiased Estimates of a Total 


In the previous paragraph, we showed that the total of 
interest is written as a total over the aggregate of the 
services in the coverage. Let us assume that we have a 
sample of respondent services j, to which we can link 
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sampling weight 6,. These weights are assumed to be 

unbiased because the sample of services follows the canons 

of a multi-stage sample, each component sample being 
unbiased. 

To make the notations easier to read, we will not show 
below all stages of the sample draw based on establishment 
ae wet: 

— s*: be the aggregate of tourist household i 
corresponding to the aggregate of services sampled 
during the survey period 

— 54 : be the aggregate of sampled establishments 

— Sp: be the aggregate of days sampled in 
establishment a, 

— 5, : be the sub-sample of services j corresponding 
to establishment day a). 


Since we have a set of sampling weights 6, for the 
respondent services, and if we know R,(B), we can 
estimate the unbiased total Y’ by 


Va =e ayy 


ies? 


(5:1) 
where 


SS iedod 8 


LO Sipe ee Ser, 


Wa 
R(B) 


This gives us an estimate of the population of tourist 
households. This formula is none other than that given by 
the GWSM_ mentioned in_ section2. Note that 
Vereen Uy intr coe Wiest Ul 90): lk unObiservicey 
was used by tour i and then 6, = es 

The variance can be estimated using the same principles 
(see Lavallée (2002)). We will not go into the details here 
because it is simply an application of general principles that 
requires somewhat onerous calculations. 

Furthermore, using auxiliary information in the form of 
totals, whether in populations U“ or in population U’, 
does not pose any particular problems for the point 
estimation or the estimation of the variance (see Lavallée 
(2002)). 


Comments 5.1. The procedure we have just described for 
sharing weights may be considered naive. In fact, we know 
how to optimize the links matrix © ,, as shown in Deville 
and Lavallée (2006). The application of the Brittany survey 
is described in Deville, Lavallée and Maumy (2005). 


6. Anexample of a Specific Problem: 
Visit Points in Open Country 


As has already been mentioned, developing the survey of 
tourism in Brittany required many complementary studies. 


Survey Methodology, December 2006 


We have already mentioned the optimization of weight 
sharing. Using auxiliary data related to the various frames 
and to the various stages of the sampling is another task. In 
this section, we want to focus on estimating some of these 
auxiliary data, in particular for visits to tourism sites in open 
country. 

In certain cases, we unfortunately do not know the total 
number of people, denoted as 7;", coming to the site on a 
given day. In effect, in aggregate A,, we do not know all 
the services (here the number of visits) of the population. It 
is therefore not possible to obtain Ho directly and therefore 
6, for j ¢ A,. To overcome this problem, we estimate the 
number of daily visitors in order to deduct in = Ny bee 

Our next step was to develop two approaches to 
estimating the number of daily visitors for sites accessible 
by vehicles only (or almost!). The first approach is based on 
a vehicle sampling system intended to estimate the number 
of visitors to the site. The second approach uses a sampling 
of visitors and is aimed at estimating the same quantity by 
interviewing individuals who give the number of people 
who travelled with him or her in the vehicle. These two 
approaches are developed in sections 7 and 8 below. 


7. Constructing an Estimator of the Number of 
Visitors Using a Vehicle Sample 


In this paragraph, we examine the approach where an 
enumerator counts the number of occupants in vehicles that 
break the line of an electronic eye, or an equivalent system 
has been set up to count vehicles for which the total number, 
written as 7,, is known with a virtually negligible 
measurement error. 


7.1 Definition and Variance of 7 s ; 


The total number of vehicles equals 


(Em Sgn ay BEI 
Klee 


leU,, 


(7.1) 


where ¢, represents the number of vehicles carrying « 
persons and U,, the vehicle universe. 


Comments 7.1. To make the notations easier to read, we 
will use here and until the end this article T, to denote 7;”. 


The total number of people visiting the site equals 


T= Dy Ki, = De 1; 
c=)... 


keUp 


(72) 
where U,, denotes the universe of people. We also have the 


equation 
ce De a) 
leU, 


(7.3) 


where v, is the number of people in vehicle /. 
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As mentioned in the previous section, the total number of 
people 7, is unknown. Consequently, we must construct an 
estimator of T>. If we let 7,, be —estimator based on s,, 
a simple random sample of vehicles of size n and with a 
probability of inclusion n/T, 

fs = brah otia = T[,V, 


n lesy 


r=1{5 
n lesy 


It is clear that 7, is an unbiased estimator of the total 
number of people 7, and that Vv is an unbiased estimate of 
the average number V of people ina vehicle. 

The variance of 7,, is therefore equal to 


: by apie |: Ls 
Wart a= Ty e - >| Ss 
n ie 


(7.4) 


assuming 


1 2 
=— Ty S; -T, S;, 
n 


(7.5) 
where S; denotes the corrected variance of population U,,. 


7.2 Constructing an Estimator of a Variable of 
Interest in the Case of a Vehicle Sample 


We want to estimate a variable of interest Y of 
population U, written as 


EN Sots 


keUp 


(7.6) 


where y, is the variable of interest measured in the final 
questionnaire. Let Y be m— estimator defined by 
v PB 
Y= » Wy Ves 


kesp 


(Gat 


where weight w, is equal to T p/m. Consequently, 
estimator Y can be written 


aed Te PAT 
Y=— > = Tey (7.8) 
m KeSp 
assuming 
ies 1 
m kesp 


Subsequently, variables 7 p and y will be assumed to be 
independent. The assumption is realistic, because we use 
two independent enumerators in the field. 


Tedel Calculation of the Variance of the 
Estimator Y 


According to Huygens’ theorem (1673), conditioning on 
sample s,, we get 
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™~ 
II 


FV arly | 
Y’ Var[7,] + Te Var[y] 
+ Var[T,] Var[Y]. 


II 


(7.9) 


In the present case, we liken the sample to a simple 
random sampling without replacement. Equation (7.9) thus 
becomes 


aes 
Ve r( Lisp ) 
Co 
+7, [+933] 
m iis 
) 
+ (7; S;-T, 5?) [ts 5 
n m vf: 


with S$? =1/(T>—1) yap aallginse Y). Reorganizing the 


terms gives 
Sis BB: 1 
= [y 4 TS; — 
n 


12 


1 
+ (-T, S))S}+ 


The next step is to determine the allocation of the sample 
sizes sp and s, that minimizes the variance of estimator Y 
for fixed population sizes 7, and 7, . 

We must therefore minimize equation (7.10) in n, m 
subject to 


C, n+ Cpm aC, 


where C,, denotes the cost (in time for example) of the 

questionnaires related to vehicles, C, the cost (in time) of 

the questionnaires related to people, and C the total cost. 
The Lagrangian equation can be written as 


pn Speley oo 
L(n, m, 4) =| Y° -—|7T, S; - 
T ey, 
P n 
2 roe 
m 
1 Bm 7, 
+7228 + L929? 
noe 


ay Se — aba S 
+A(C, n+ Cpm-—C). (7.11) 


Taking the partial derivatives with respect to variables 
n, m, ® and setting them equal to zero gives 
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aL ope 1 
—(n, m, 4) =| Y? -— 1 83-5) 
za ) | T | ss n 


P 
PD Pale) (ai? ] 
mn 

1 AiGy =U, 


— (Hom, N= (Ee ABS Se [=] 
m m 
soil bays 33-5 
nm 


+ NE, =0; 


= (, m, \)=C,pn+Cpm—C=0. 


After calculations, we get a third-degree equation in n 
that is written 


NOE ees AC, Cn? 


= G4 
=p CTs s(F - 7) 


P 


Cs ee ? 
+ rsilc[7 - ae cn8] =n). 
[> 


This third-degree equation in 7 allows a real solution 
that can be determined using numeric methods. 
Using the same reasoning, we get a third-degree equation 
in m 
ACpm — ACpCm? 
— Cp Sy (Tp eT, Sy )m 
+S? (CUS PBASS HOCH Tab 0. 


7.2.2 Simplified Case 


To simplify the variance calculation of estimator Y, we 
can make an approximation in equation (7.10). In effect, we 
can assume that term 1/nm is negligible before terms 
1/n and 1/m. 

This then gives us the following transformation of 
equation (7.10) 


; I 
ACT arse so eae 
m 
eS ee ; 
+ 1S’ Sy YT, Sy 
Tp 
Sa (112) 
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The next step is determining the allocation of the sample 
sizes s, and s, that minimize the variance of estimator Y 
for fixed population sizes 7, and 7, . 

We must therefore minimize equation (7.12) in n, m 
subject to 

Gins Compe G 
The Lagrangian equation can be written as 
2 
L(n, m, 4) = 7? —2y | 722} 
I> n 
1 
+ Up -Ty 8) Sy — 
m 
+9292 77, 82 
Vays VoOV 

T, 12 
-T, S; 

PAG a te Cie) | uel) 


Taking the partial derivatives with respect to variables 
n, m, and setting them equal to zero gives 
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After the calculations, we get 
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8. Constructing an Estimator of the Number of 
Visitors Using a Sampling of Visitors 


The previous method can be complicated and costly to 
use at certain sites. A simpler data collection method 
involves asking person k the number uw, of passengers in 
vehicle i that transported him or her. This number u, is 
equal here to v, for vehicle / that transported person k. 
This method has the further advantage of accurately 
capturing the number of passengers within the meaning of 
the survey (are babies counted?). 
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8.1 Definition of 7, 


Let us go back to the following equation 


Tp = Ds Ve, 


1eU, 


where v, denotes the number of passengers in vehicle /. 
Let us also recall 


fea rie 


l<eUp 


The average number of passengers ina vehicle V can be 
expressed as 


where ¢, is the number of « — passenger vehicles and V/, 
is the number of people who came in a k — passenger 
vehicle. 

We can use this last relation to obtain a new version of 


Tp 
fy ie 7 (8.2) 
Consequently, an estimator of 7, can be written as 
fia Tel, (8.3) 


where the total number of vehicles 7, 1s perfectly known. 
Observing this expression, we see that, in order to know 
estimator ib p» all that is required is to determine the quantity 
V. Let us therefore introduce the following estimator of V 


where m,, is the number of people in the sample travelling 
in a « passenger vehicle. Estimator V can also be written 
as follows: 

ind 


kesp 


5 SSedifiow 


kesp 


nie, 


Or as 


A 


m 
ain — arate 
yaa, 


kesp 


(8.4) 


The last equation makes it possible to write the following 
equation 


= — —. (8.5) 
This new quantity represents the empirical average of 


1/u, and V is the harmonic average of u,. It is also 
possible to calculate its variance, which is equal to 
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Comment 8.2. If variables r and y are not independent 
i 1 l 2 Je 
Var im zy lke Te Siu: (8.6) then we would have 
Var f y | = y’ Var| 7, | + T; Var[y] 


8.2 Calculating the Variance of Estimator 7, A ' 
Without a Vehicle Sample + Var 7, 7 Var[y] 
Now we have to calculate the variance of estimator 


knowing (8.6). To this end, note that we can write 


+ terms not linked to the 


eventual non-independance 


of the variables 7 p and y. 


9. Numeric Illustration 


A mechanical counter at a site in open country gives 
T, = 100 vehicles. We assume that 20% of the vehicles 
} have one person, 20% have two people, 20% have three 


people, 20% have four people and 20% have five people. 
This means there are 300 visitors to the site. The variance 
S; is equal to two disregarding finite population 
corrections. The average number of passengers V’ is three. 


Accordingly, this gives 
2 aS 
var | = (=| x VarlV] In effect, we have: 


40 60 
x — 


eu a 
300% 83.0) 300 


1 
Lastly, we have B00, 12 


Var[V] = 7* x var| 2 
V 
which gives V = 3. 
Let us now calculate an estimate of S,,. After 


or, with (8.6) 
simplifications of (8.8) and assuming that 7, is large 


A — 1 
Var[V] = V* x (+ = =| Bf (8.7) 
m tT, enough compared to one, we have 
By definition, variance S/,,, is equal to 2 ] (Me 
SV Sig > ee lies ls 
2 ie keU uy, V 
| l l ‘i 
Sais —-.|. (8.8) 
Te yao nk Uy V Thus, we get 
Since quantity 7, is unknown, this relation can be oes si eerlariyer 2 bs de 4 lene Be 
estimated by TO 36) a0 3? 
1 ao ep — 1 (60 + 30 + 20 + 15 + 12 1 
DU lie (8.9) 950 30 pz 
m — |. pagel V 
; ; 137 l 37 
Given (8.7) and (8.9), we can easily determine the ae sir Aaah cer i= romeo 
variance of estimator V and consequently, that of estimator Ne 2 _ 
Since we know Sj,,, we can calculate the variance of 


T,, and lastly, that of the variable of interest Y. 
biased and estimator /. This gives 


8.1. Estimator rm is 
37 


Comments 
Var[V] = 3* x x —, 
i") 30° 


asymptomatically unbiased. 
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Lastly, we can calculate the variance of estimator 7, 


Var 7 ie Var| F’| 
oy) 


10* x 3 x => x =. 
30 m 


I 


The first approach gives a variance of estimator 7 p equal 
to 


% 1 
Marl pulsed eae 2a ae 
nN 
Thus, for estimator 7,, to have the same variance as 
estimator 7,, size m ofsample s, must be equal to 


m = 1.66n. 


Our initial conclusion is that the second approach makes 
field operations simpler and less costly in terms of personnel 
because it only requires one enumerator. It is more accurate 
than a count that does not involve direct contact to obtain 
the composition of the tourist household. It requires only 
one sample about one and a half times larger than the first 
approach to produce the same accuracy, which is tolerable 
given the resulting simplification of collection. In practice, 
at all sites, the second approach will be the preferred 
application. 


Conclusion 


This article presented a broad description of a new 
method applicable to tourism statistics. It involves capturing 
tourists based on the consumption of certain services on 
which probabilistic samples are constructed. The weight 
share method makes it possible to shift from statistical 
accuracy of the services to the accuracy of the relevant 
tourism statistical units: the tour, the trip, the tourist 
household, the tourist or the tourist-night. However, the 
method requires numerous adaptations and complements to 
the weight share. We described one of these in detail, which 
is the estimate of the number of visitors to a site in open 
country. Two methods were tested. One, which was more 
accurate in terms of sample size, requires a relatively 
extensive organization and runs the risk of unacceptable 
errors in measurement. At the price of collecting slightly 
more data, the second method is preferred. 

Other studies of this nature were conducted before and 
during the time of the survey so that it is difficult to present 
the full methodology in a single article. 
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Combining Link-Tracing Sampling and Cluster Sampling to Estimate 


the Size of Hidden Populations: A Bayesian-Assisted Approach 


Martin H. Félix-Medina and Pedro E. Monjardin ' 


Abstract 


Félix-Medina and Thompson (2004) proposed a variant of Link-tracing sampling in which it is assumed that a portion of the 
population, not necessarily the major portion, is covered by a frame of disjoint sites where members of the population can be 
found with high probabilities. A sample of sites is selected and the people in each of the selected sites are asked to nominate 
other members of the population. They proposed maximum likelihood estimators of the population sizes which perform 
acceptably provided that for each site the probability that a member is nominated by that site, called the nomination 
probability, is not small. In this research we consider Félix-Medina and Thompson’s variant and propose three sets of 
estimators of the population sizes derived under the Bayesian approach. Two of the sets of estimators were obtained using 
improper prior distributions of the population sizes, and the other using Poisson prior distributions. However, we use the 
Bayesian approach only to assist us in the construction of estimators, while inferences about the population sizes are made 
under the frequentist approach. We propose two types of partly design-based variance estimators and confidence intervals. 
One of them is obtained using a bootstrap and the other using the delta method along with the assumption of asymptotic 
normality. The results of a simulation study indicate that (i) when the nomination probabilities are not small each of the 
proposed sets of estimators performs well and very similarly to maximum likelihood estimators; (ii) when the nomination 
probabilities are small the set of estimators derived using Poisson prior distributions still performs acceptably and does not 
have the problems of bias that maximum likelihood estimators have, and (iii) the previous results do not depend on the size 
of the fraction of the population covered by the frame. 


Key Words: Bayesian approach; Capture-recapture; Design-based approach; Finite population; Hard-to-access 


population; Maximum likelihood; Model-based approach; Sampling frame. 


1. Introduction 


Link-tracing sampling (LTS) has been found appropriate 
for sampling hidden and hard-to-access human populations, 
such as drug-user, homeless-person, or illegal-worker popu- 
lations. In this sampling method, an initial sample of people 
from the target population is selected, and the people in the 
initial sample are asked to nominate other members of the 
population. The nominated people who are not in the initial 
sample are included in the sample and they might be asked 
to nominate other persons. This process might continue until 
a specified stopping rule is satisfied (for a review of LTS, 
see Spreen 1992, and Thompson and Frank 2000). 

Although LTS allows the sampler to make valid model- 
based inferences about a number of population parameters, 
in practical applications the assumptions about the initial 
sample are difficult to satisfy. (See Snijders 1992, Frank and 
Snijders 1994, and Heckathorn 2002). For instance, Frank 
and Snijders (1994) developed a variant of LTS in which the 
initial sample is a Bernoulli sample, that is, elements in the 
initial sample are included independently and with equal 
probabilities; however, in real studies the initial recruitment 
is generally carried out by using records of people obtained 
from health centers or police stations, and this induces a 
selection bias known as institutional bias. 


The difficulty in satisfying, in practical situations, the 
assumptions about the initial sample motivated Feélix- 
Medina and Thompson (2004) to develop a variant of LTS 
which does not require an initial Bernoulli sample. They 
assume that a portion, not necessarily the major portion, of 
the target population is covered by a sampling frame of 
accessible sites where members of the population can be 
found with high probability (for instance bars, hospitals, 
blocks or parks). A simple random sample of sites is 
selected, and the members that belong to each site are 
identified. Finally, as in ordinary LTS, the people in each 
site are asked to nominate other members of the population. 

Those authors derived maximum likelihood estimators 
(MLEs) of the population sizes from probability models that 
describe both the number of elements found in each site and 
the probability that a member is nominated from a site, 
which is called the nomination probability. They also 
proposed model-based and partly design-based variance 
estimators, that is, estimators based on both the design used 
to select the initial sample and the assumed models. 
Throughout this paper we will call this type of estimator a 
“design-based-like” estimator. By a simulation study, the 
authors showed that the MLEs of the population sizes and 
their design-based-like variance estimators are robust to 
deviations from the assumed model, but that the model- 
based variance estimators are not robust. In addition, they 
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found that the MLEs tend to seriously overestimate the 
population size if the nomination probabilities are small. 

As indicated by those authors, the problem of 
overestimation that appears when the nomination 
probabilities are small is caused by the small amount of 
information contained in the sample, which is not enough to 
obtain stable estimates of the nomination probabilities. They 
suggest that a possible solution to this problem is to use the 
Bayesian approach to construct estimators that incorporate 
additional information about the population parameters. 

In this work we use the Bayesian approach to assist us in 
the construction of estimators of the population sizes, while 
we make inferences under a frequentist approach. Thus, in 
addition to deriving point estimators we construct confi- 
dence intervals. For this purpose we use the strategy 
proposed by Feélix-Medina and Thompson (2004) to 
construct confidence intervals based on the normal distri- 
bution and using design-based-like variance estimators 
obtained by the delta method. In addition, we construct 
design-based-like bootstrap confidence intervals. We have 
named this inferential approach “Bayesian-assisted”’. 


2. Sampling Design and Notation 


The structure of the population and sampling design 
considered in this paper are the same as those proposed by 
Félix-Medina and Thompson (2004). A brief description of 
them follows. Let U ={u,,...,u,} be a hidden human 
population of unknown size t. Let U, be a subset of U 
formed by an unknown number t, of people that can be 
found in different accessible sites, such as bars, parks, or 
blocks. Two assumptions about this sampling design are 
that a sampling frame of N of those sites can be constructed, 
and that the researcher has an operational rule which allows 
him or her to determine whether or not a person belongs to a 
site in the frame and, in the affirmative case, to locate that 
site. Notice that the subset U, covered by the frame is not 
assumed to be the major part of U and that, as in ordinary 
cluster sampling, a person in the frame is assumed to belong 
to only one site. Let A, be the ith site or cluster in the 
frame and m, be the number of people who belong to 
Ay i att... Ngathetixs, => iompoinally, ets, = Wiest, 
be the portion of U not covered by the frame and let 
t= t=, beits.size. 

The sampling design is as follows. A sample S, = 
{A,,...,A4,} of n clusters is selected from the frame by 
simple random sampling without replacement, and the m, 
persons who belong to each A; € S, are identified. Note that 
we have used the subscripts 1, ..., 7 to denote the clusters in 
Sy; however, this does not mean that the first 7 clusters in 
the frame are necessarily the clusters in the sample. Next, 
the people in the sampled cluster 4, are asked to nominate 
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members in U, but only nominees in U — A, are considered. 
This procedure is repeated for every cluster A, e¢ S,. As a 
convention, we will say that a person is nominated by a 
cluster if he or she is nominated by at least one member of 
that cluster. Nominations from different clusters are carried 
out independently, and different nomination strategies can 
be used in different sites. For instance, in site A, the m, 
members, as a group, could carry out the nominations; 
whereas in another site A, each of the m, members could 
make nominations separately. Finally, for each nominee the 
researcher has to register the site or sites that nominated him 
or her, and the section U, or U,, to which the nominee 
belongs. Notice that this last piece of information could be 
obtained from the person who made the nomination or, if 
that is not possible, from an interview with the nominee. 

The nomination of people by clusters will be indicated by 
the matrices X, = fat pae and X, = pee where 
x) =1 if person uw; €U, — A, is nominated by cluster 4, 
=0 if u,;¢A, or uw, is not nominated by 4,. 
Similarly, age =1 if person u,¢U, is nominated by 
cluster 4,, and x\°) =0 otherwise. As noted by Félix- 
Medina and Thompson (2004), X, and X, are only known 
up to permutations of their columns because the people are 
not labelled. Therefore, inferences about t, and 1, are 
based on the set of counts y={y,}, where ¥y,, 
oc Q=({l,...,n},@#M, indicates the number of people 
in U who are nominated by every sampled cluster A, with i 
in the set o, but not otherwise. For instance, if 
w = {4, 7, 8}, y,, would be the number of people in U who 
are nominated by only A,, 4, and A,. 


NXT? 


3. Estimators of the Population Sizes Based on 
Posterior Modes 


Félix-Medina and Thompson noted the resemblance 
between their sampling design and that of multiple capture- 
recapture sampling (MCRS). This makes it possible to apply 
to our case some of the Bayesian models that have been 
proposed for analyzing MCRS. See Fienberg, Johnson and 
Junker (1999) for a review of Bayesian analyses of MCRS. 
In this work, we use a model considered by Castledine 
(1981) for the prior distributions of the logits of the 
nomination probabilities, along with some models for the 
prior distributions of the population sizes. 

As in Félix-Medina and Thompson (2004), we will 
suppose that the sizes m,,..., 7m, of the clusters 4,,..., Ay 
are realizations of independent Poisson random variables 
M,,..., My with mean 2,. We will denote by p\? the 
probability that a person in U, — A, is nominated by the site 
A, € Sy. The probabilities p) will be called nomination 
probabilities. In addition, we will suppose that conditionally 
on the sizes m,,...,m,, of the clusters in S,, on t, and 7,, 
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and on the p;'’’s, the variables x,’ are realizations of 
independent Bernoulli random vatiables X\ with means 
ey Se and yk 1D) 

Feipenedirta and Thompson (2004) used the fact that 
the joint conditional distribution of (M,,...,M,, 
t,->! M,), given that Dj) m,=1,, is a multinomial 
distribution with parameters t, and (1/N,...,1/N, 
l1—n/N), and applied a procedure used by Darroch (1958) 
to show that the likelihood function of 1,,1,,p, ={p!?}? 
and p, = {p' © }; is the product of the following factors: 
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where m, = {m,}/;m= Xj m, 1s the observed value of the 
random variable M that indicates the number of people in 
Sas pS = {y ey Core and y* = As 
oxo» 4 € Sp, are the sets of counts obtained from y, 
fos correspond to the counts of nominated people in 
Pe SU. sandwAyeS 5 respectively izi=) ae 
yi", Ce eS and. 252 uy Mare the 
observed values of the random variables Z‘”, Z°° and 
Z° that indicate the numbers of distinct people in 
S,,U,-—S, and U,, respectively, that are nominated by 
A;; and 7% = Loz var it 1 = Lowe yy? and W, = Yoso 
y\“) are the observed values of the random variables 
R,,R, and W, that indicate the numbers of distinct people 
in U,—S,,U, and A,, respectively, that are nominated by 
at least one of the clusters in S). 

We will now focus on the problem of defining the prior 
distributions of t,,t,,p, and p,. In the case of t, and 7,, 
we will consider the following three models for the prior 
distributions: 

Poisson-Gamma Distributions 


TT, |A, ) oc (Ni, )" hata! and TA, ) ae peice is 
Mts) 0002/5 tand:n(A,) Agen 72, 
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where a,,b,,a,,b, are known constants, and (t,, 
(t,,A,) are independent. 


X,) and 


Jeffreys’ Distributions 


Mt, elite swnere = 12, 
independent random variables. 


and t, and t, are 


Uniform Distributions 


m(ty) ocd; where A=I1,2, and +, and 1, are 
independent random variables. 

The prior Poisson distribution of t, defined in the first 
case is motivated by the fact that t, =) M,, and that M, 
is a Poisson variable with mean A,. Notice that this case 
allows the researcher to use information about t, and t, 
which is known prior to the observation of the sample. On 
the other hand, the distributions defined in the other two 
cases are not informative. 

In the case of the nomination probabilities p, 
following Castledine (1981), we will suppose that i 
pe ’s are exchangeable and will use his two-stage normal 
model for the logits Chie log[ p”” /A- pe] of the 


() >6. 
dD; S: 


(k) 5 


a0, ~ N(,, 0%), 


and Oe NC nv t= lee ts 1s, Kaede, (1) 


where N(0,,6;) stands for the normal distribution with 
mean 0, and variance o7;07,u, and y;, are known 
constants; and the a‘’’s are conditionally independent 
given 9,. Under the assumption of exhangeability the 
Co ’s are not independent, but information about any one 
of them is used to obtain information about any other of the 

as. Of course, if we wanted independent priors for the 

ott? ’s, we could obtain : one-stage normal model from (1) 
by setting 8, =, and Y; ml Ul la 

Finally, we will suppose that all the random vectors 
(Thy) all (Oe), 2 where ae, —_ Ores 
k =1, 2, are mutually independent. 

Although we defined three types of prior distributions for 
Tt, and t,, they can be treated in a unified way because the 
prior marginal distributions of t, and t,, obtained from 
the Poisson-Gamma distributions, are the Negative binomial 


distributions: 
a VG hap WY, 
Ta N+65, 


Bia, 32s ie 7 al fi 
t5! Lette -44 


where I'(-) denotes the Gamma function. The Jeffreys’ and 
Uniform distributions are limiting cases of (2) obtained by 
making a,=6,=0,k =1,2, and a, =1, b, =0, k=1, 2, 


n(T, ) 


and TT) OC 
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respectively. Note that the Gamma distribution is not 
defined for these values of a, and 6,; however, for the 
derivation of the estimators we can use these values in (2). 

The posterior joint distribution of 1,,7,,a@,, and a, can 
be expressed as 


CTS, OO, |data) 


We Fa) exp[az] 


(x, —-m-7)(N +5)" i=l [1 + expla!) | % 


Bt Yat a) 2 | 
poe. ) 


20; T(t, +a,) 


x exp : 
oy (TT Dee) 
2V; | 
gD Nd 
n 2)0) 205 
exploj 2; |] 2 
x[] —exp (3) 
4 rete | @® wy 
I: 2V, 
where z\? =z! +z" is the observed value of the 


random variable Z{? =Z°+Z° that indicates the 
number of distinct people in U,, either in S, or in 
Ui 15 es a Dab ue nominated bY, A;; ;a@ is the arithmetic 
mean of the a; and v, =; +6; ies k =1, 2. 

Since we cannot compute the analytical integral of (3) 
with respect to a‘ and a, we will not try to obtain 
expressions for the posterior distributions of t, and t,, but, 
as in Castledine (1981), we will use the mode of 
Th (ys Toy Oy.'O5\data) as an, estimator Of, (41545 10). 
Using this strategy, we have that the proposed estimator is 
the solution to the system of equations: 


M+R,+(1-n/N)[N(a,-l) (N45, WI dp") 


A i=] 


q a n e) 
1-(l-n/N)[N((N +8,)]] [ G- 2”) 
T=) 
Bay exp {ai} i Za in Ge? a gq) 
~ L+exp {a} #,-M, (t,-M,)o; 
rhe 
ES aS ety 2% (4) 


n(t, — M,)v, : 
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_ Reta, D +b MT = BP), 
: [Vd +5,)I] [2 @- 62) 
RIOD) at exp{a\”} cs Le On Ose 
l+exp{ai?} 4, 4,05 
ol”? 
beg eT Lashes =, 265M, (5) 
NEV» 


where a? = >" a) /n,k =1, 2. From this, an estimator of 
eis = Gace, 

The forms of these estimators are basically adjustments 

to the forms of the MLE’s proposed by Félix-Medina and 
Thompson (2004) so that the proposed estimators Hany 
rate the initial information about t, and a\”,i=1,. 
k =1, 2. Also, as a referee has noted, the estimator att ) fe 
the form of the MLE of p\? followed by shrinkage terms, 
one of one ) toward the arithmetic mean «, and another 
of a” toward the prior mean p1,. 


4. Confidence Intervals for the Population Sizes 


As was indicated earlier, we will use the frequentist 
approach to obtain design-based-like confidence intervals 
that are robust to deviations from the assumed Poisson 
distribution of the M,’s. We will consider bootstrap 
intervals and Wald intervals based on a normal approxi- 
mation (see Agresti 2002, page 13 and Evans, Kim and 
O’Brien 1996 for the latter terminology). 


4.1 Bootstrap Confidence Intervals 


We will use a version of the bootstrap obtained by 
combining the bootstrap variant for finite populations 
proposed by Booth, Butler and Hall (1994) and the 
parametric bootstrap variant (see Davison and Hinkley 
1997, Chapter 2). 

The steps of the procedure that we propose are the 
following. (1) Construct an artificial population of N values 
of m,’s by repeating N/n times, assuming that N/n is an 
integer, the selected sample of 7 cluster sizes m,,...,m,,. If 
N=kn+r, where k and r are positive integers, construct 
the population by repeating k times the selected sample of 
cluster sizes and add to this set of m,’s a simple random 
sample without replacement (SRSWOR) ofr values of m,’s 
selected from the observed sample of 7 cluster sizes. (11) 
Select a SRSWOR of size n from the population of the 
Wi S. Let he. 1, a Deuiie indices of the m,’s in the 
sample. (ii) For each i=i,...,i,, draw samples of sizes 
tHe wt ie from Bernoulli distributions with means 
p” and p\, respectively, where EMTS p. wane ie are 
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the estimates of t,,t,, p{ and p‘ computed from the 
original observed sample. These samples simulate the 
values of the sets oom and {ont of indicator variables. 
(iv) Compute estimates of t,,t, and t from the samples 
drawn in steps (11) and (ii1) using the same procedure as that 
used to compute the original estimates 7,,t, and Tt. (v) 
Obtain the bootstrap distributions of %,,t, and t by 
repeating (i)—(iv) a large number B of times, and computing 
the empirical distributions from the sets of B values of 
t,t, and %. (vi) Construct the 100(1—a)% _ bootstrap 
confidence intervals for t,,t, and t by using either the 
basic or the percentile method (see Davison and Hinkley 
1997, Chapter 5, for descriptions of these methods). In the 
basic method the interval for t is [2t-7#°°°”, 2% - 2], 
and in the percentile method it is [t”, 7°], where 
e) and **” are the lower and upper a/2 points of 
the bootstrap distribution of the original estimate 7 of T. 

Note that this variant of the bootstrap does not use the 
assumed Poisson distribution of the MM, ’s, but it uses the 
sampling design employed to select the initial sample of 
clusters. Thus, we can consider that the resulting confidence 
intervals are robust to deviations from the assumed 
distribution of the M,’s. 

If bootstrap estimates of the variances of 1,,7, and T 
were also desired, simple estimates could be obtained by 
computing the sample variances of the sets of B values of 
those estimators. 


4.2 Wald Confidence Intervals 


Though in this work we will not justify theoretically that 
the proposed estimators of the population sizes are 
asymptotically normally distributed, we will suppose that 
the normal distribution is a reasonable approximation to the 
distributions of the estimators. Thus, we will construct 
100(1—a)% _ design-based-like Wald confidence intervals 
for the population sizes, which have the form 
Gy eer s V(z,), where Z1-« 18 the upper a/2 point of 
the standard normal distribution, and V(t,) is a design- 
based-like estimator of the variance of 7,. 

To construct this type of interval, we will firstly derive 
design-based-like variance estimators by applying the same 
strategy as that used by Félix-Medina and Thompson 
(2004). In that strategy, the distribution of the cluster sizes is 
not employed, but it is replaced by the distribution of the 
sampling design used to select the initial sample S). This is 
carried out by means of the formula: 


V(t,) = V,[E.(t,|m, )]+ E,[V.(t,|m,)], (6) 


where E,(t,|m,) and V,(t,|m,) denote the conditional 
model-based expectation and variance operators, given that 
M,=m,; and E,(-) and V,(-) denote the design-based 
expectation and variance operators. Thus, the variance 


ea 


estimators are obtained by applying (6) to the first-order 
Taylor’s approximations a; and ts Oi 17,1) and wis5, 
respectively, about the model-based expectations of c\ = 
(M,, Ze » A,) eeamnd oo (7: R,), Where zi") = 
(Z, wt Z), k =1,2. 

Using the previously described strategy, and the fact that 
Z\m, ~ bin(t, —m,, p’”) and R,|m, ~ bin(t, - m,1- 
Q,), where Q, =[]'., (— p‘”), we have that an estimator 
of V,[E.(7;|m, )] is 


i 
W,, = (l= n/N)R? —_Y) (m Sy (7) 
ile lia 
where m=n' >! m:; K==0, [A (@,-m-7)];O,=Ty 
ae. 
Py eke Pec 
a Be oe: Sey tC teal A wl (dame 


BY = Gsm )pO I= pO) Fo, f= 1.02, 0: 


and 


p 
-1 —2 = P(e ra) 
(Via 0; \|n pL per: | 


Lene nay eB 


In addition, since Cov(Z"", R,|m,) = (t, —m)Q,p”, a 
estimator of E,[V. (7;|m, )] is 


2 
n (1) =Ay) 
2 Z | G —m,)p (1- p) 


= mG,0-9) 
(4, -m-ny 


_ 2%, =m)Q, 


dae pe ) Be 
» Pi me pe 
] I 
= hy eet B\ 


oe n Aas 2G. ey DB 
a l+n- Ce Ai ox nN Ss oleh On 


where 


Therefore, a design-based-like estimator of V(t,) is 
VG) =V,,+Vi>- 
In the case of t,, since Z”|m, ~ bin(t,, P;) and 
R,|m, ~ bin(t,,1—Q,), where Q, =[]2, (1-p ie it 
follows that E.(4;|m, ) does not depend on m,, and 
consequently that V pLE, (Im, )] = 0. imererare! | since 
Cov(Z™, R,|m, y=4, 0p , anestimator of V(t,) is 
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: Be aD (2) (2) 
saan heer ae 
i=l Bo ; 
: et ea, (Pe 
V(i,) =A? + 20-2) 2.) (10) 
(1, —1) 
APNG? . pi? -D, 9 (2) 
§, pee | BO) ha 


where Q, =[T%, (- p), 


2) ae » (2) so eae 
Bi = pole p Ja Oi lan, 


2 
1 Det Nt (ee) 

Q ia 16, )|n 2A jaeeyiiss | 

oe n'(v;' —noy Vy ae BO? 


and 
A pnl 2) 1S" 22) / AQ) 
Ah _n (yy —no, )n i pe /B; 
20> pantie ere er en a NE 
l+n'(v;'-—no;)n eG Wiese 


Finally, since the no dependency of E, (¢;|m, ) on m, 
implies that Cov(t,,t,)*0, it follows that a variance 
estimator of t is V(t) = V(t,) + V(4,). 


5. Monte Carlo Study 


We considered four populations; a description of each 
one is presented in Table 1. In the pair formed by 
Populations I and II the frame covered about 45% of the 
population, whereas in the pair formed by Populations III 
and IV the frame covered about 70% of the population. The 
populations of each pair were very similar, except that in 
one of the populations of each pair the distribution of the 
M,’s was Poisson, whereas in the other it was Negative 
Binomial. The nomination probabilities i Pee N, 
k=1,2, were generated using the model rd =]- 
exp(—B,m,), where the values of B, were set so that the 
following values of p“? =X" p/N were obtained. For 
Populations I and I: (p, p™)*(0.05,0.01) and 
(p', p™) ~ (0.01, 0.002). For Populations Il and IV: 
(p°”, p) (0.05, 0.03) and (p , p)~(0.01, 0.006). 
The model employed to generate the ja )°s is a model used 
in catch-effort methods (see Seber 1982, Chapter 7 for a de- 
scription of those methods). As an associate editor has 
noted, this model implies that the number of people nomi- 
nated by cluster A, has expectation (t, —m,) 
(1 —exp(—B,m;)) + 7,(1—exp(-B,m;)), and consequently 
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the number of nominated people is approximately 
proportional to m,. Notice that the assumed exchangeable 
model for ph does not entail such a relationship with m,. 
Since the estimation of pe depends mainly on zi | the 
number of people in U, nominated by the cluster 4:., we 
expect the omission of this relationship not to affect the 
efficiency of the estimator of p\’. Darroch (1958) has 
shown, in the case of maximum likelihood estimation, that 
no significant gain is obtained by assuming the catch-effort 
model. 


Table 1 
Parameters of Simulated Populations 


Population I Population I Population III Population IV 
N= 250 ND 50 N=250 N= 250 
M, Poisson M,; Neg. Binomial M; Poisson M, Neg. Binomial 


E(M,)=7.2. E(M,) =7.2 
V(M,) =7.2 V(M,) = 24.48 


E(M,)=7.2. E(M,)=7.2 
V(M,) =7.2. V(M,) = 24.48 


1, =1,811 1, =1,872 1,=1,811 +, =1,872 
t =2,200 t, =2,200 t=700 1, =700 
t=4,011 1=4,072 t=2,511  1=2,572 
1,/1=0.45 1,/t=0.46 1,/t=0.72 1/1=0.73 


For Populations I and II the values of the parameters of 
the prior distributions were o; = 25, u, =—3.5, 7; = 25, 
k=1,2, a, =1,. 6, =0.15 a, = 7.84, b, = 0.0028 anise san 
E(A,) =10, V(A,) = 100, E(A.,) =2,800, and V(A,) = 10°. 
For Populations III and IV the values of the parameters were 
Gi Ope = OKT DY ae, be. im 8, 
b, =0.01, so that E(A,)=10, V(A,) =100, E(A,) = 800, 
and V(A,)=80,000. These values imply that the prior 
distributions are well dispersed over relatively large 
intervals that contain the parameters of interest. 

The simulation experiment was carried out as follows. 
From each population of N=250 values of m,’s, a 
SRSWOR of n=25 values was selected. From cluster A, 
in the sample, the values of X v and X on were generated 
by drawing samples of sizes t, —m, and t, from Bernoulli 
distributions with means pe and pee respectively. These 
data were used to compute the following estimators of the 
population sizes: the set of MLEs 7,,t,, and T=7T, +T, 
proposed by Feélix-Medina and Thompson (2004); and the 
three sets of Bayesian estimators t/,t5, and t° =7/ + 7}, 
a=U,J,P, obtained by using as prior distributions the 
Uniform (U), Jeffreys’ (/), and Poisson (P) distribu- 
tions, respectively. In addition, variance estimators and 
confidence intervals were also computed. Bootstrap 
intervals were computed by the basic method, with the 
exception of the intervals based on the estimators 7), t) 
and ¢’, which were computed by the percentile method. 
All bootstrap estimators were obtained by using 2,000 
bootstrap samples. Finally, the performance of the point and 
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interval estimators was evaluated by using r = 10,000 trials 
of the previous procedure. 

The performance of an estimator 7, say, was evaluated 
by its relative bias and the square root of its relative mean 
square error, defined as r—bias= >) (t,—1)/(rt) and 
Vr —mse = ,/>/(t, —t)’ (rt’), where 7, was the value 
of t obtained in the ith trial. The performance of a 
variance estimator was also evaluated by its relative bias 
and the square root of its relative mean square error, which 
were similarly defined to those of an estimator of the 
population size, but using the empirically determined 
variance instead of the real variance. Finally, the 
performance of the 95% confidence intervals was evaluated 
by their coverage probabilities and their average lengths. 


6. Results and Discussion 


Because of restrictions of space, in Tables 2 to 4 we 
present only a selection of the results of the numerical study. 
However, the next comments refer to the complete set of 
results. 

Despite the limitations of the simulation study, we can 
conclude that the main factor that affects the performance of 
the estimators and confidence intervals is the magnitude of 
the joe *s| When they are large and regardless of the 
distribution of the M,’s and the size of the fraction 1, /t 
covered by the frame, every one of the estimators of the t’s 
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are small and in spite of all the other factors, only the 
Bayesian estimators %, perform acceptably. It is worth 
noting that when the sae *s are small, the Bayesian 
estimators t;, and t/ perform better than the MLE’s 7,; 
however, the performance of t, and t is not good 
enough to make reliable inferences. 

Bootstrap confidence intervals for t, based on 7; did 
not perform as well as Wald intervals when the p\” ’s were 
small or the M,’s were not Poisson distributed. The 
explanation of this result and the development of better 
bootstrap intervals are topics that require further research. 

Finally, the best performance of the set of estimators 7 
is a consequence of the greater amount of information used 
by them. Though we used relatively flat prior distributions 
for the t,’s, the information supplied by them was enough 
to avoid the problems of bias and high variability observed 
in the other estimators. We carried out some additional 
simulation trials, and the results (which are not reported in 
the tables) indicate that, as long as the prior distributions are 
kept relatively flat, the estimates are not affected by the 
values of the parameters of the prior distributions. 
Obviously, misleading initial information combined with 
small values of the p\”)’s will affect the estimates. An 
example of this is a prior distribution for t, with a 
probability density function highly concentrated about a 
value very far from the true value of t,. However, we think 
that if the researcher has correct information, even if it is 


vague, it would be worthwhile using the set of estimators 
AP 9» 


and design-based-like confidence intervals (Wald or tS: 
bootstrap) perform satisfactorily. However, when the ee S 
Table 2 
Relative Biases and Square Roots of Relative Mean Square Errors of the Estimators of the Population Sizes 
Population I Population II Population II Population TV 

Pi 0.05 0.01 0.05 0.01 0.05 0.01 0.05 0.01 
Pr 0.01 0.002 0.01 0.002 0.03 0.006 0.03 0.006 

rp re” rp re” rp re? rp re? rp re” rp re? rp re? rp re” 
%, —0.00 0.02 -0.00 0.06 —-0.00 0.02 -0.01 0.09 -—0.00 0.02 -0.00 0.06 -0.00 0.02 -—0.01 0.09 
Z> Vole om) 027" 07S 00T” “0:1oe 001 0767" «000M OG O1T 67 ™ 0.007 O00 016% 0.63" 
T Oe 00 Oise 04s OOT™ 0.07" Oe Odo 10.00. O02 0056 019-000 + O0e 0.04 018: 
‘7 0.00 0.02 -0.00 0.06 -0.00 0.02 -—0.01 0.09 -0.00 0.02 -0.00 0.06 -0.00 0.02 -0.01 0.09 
a O07 Osoee Ds O65 OUT) O12 OAR 6s 00s OUR Oo (06> «VON O00G.” Ota 60.71 
. Ol O07; 008 = 036" O01 0.07" 0.087 7036" °0.00"" 0:07 0.03" 019" —0.00"” 0:02" 0.03" "" 0.20 
t/ 0.00 0.02 -0.01 0.06 -0.00 0.02 -0.01 0.09 -0.00 0.02 -0.01 0.06 -0.00 0.02 -0.01 0.09 
#3 -0.00 0.12 -0.14 048 -0.00 0.12 -0.14 0.48 -0.00 0.06 -0.04 0.37 -0.00 0.06 -0.04 0.35 
* ~*—0.00°” 0.07 —0.08" 0.27°°-0.00° 0.07 —0.08” 0.27 “-0.00" 0.02 '—0.02'” 0.11 —0.00 0.02 —0.02 " °0.12 
sP 0.00 0.02 -0.01 0.06 -0.00 0.02 -0.01 0.09 -0.00 0.02 -0.01 0.06 -0.00 0.02 -0.01 0.09 
+ Ooh OO Toe 20 O02 = OT S20, 07 nen. 20 =. 0,00 2006-2 0,00 20.18 2".:0.00:— 006" —-0.0F 0.18 
ani OL OG eset IIT OOF SOG? 0.03 ONT O00 7002000" 0.074+-0.00. 002 = 0.08 O08 


A . Pp . oo a Py . . A A x 
rB, relative bias; re~, relative mean square error; 7,,t, and t, MLEs. Superscripts U, J, and P of estimators 7,,7, and t 


indicate Bayesian estimators based on the prior Uniform, Jeffrey’s and two stage Poisson-Gamma distributions, respectively. Results 
based on 10° trials. Superscripts a, b and c indicate results obtained by ignoring 8%, 15% and 21% of the trials. Ignored trials were 
those in which the corresponding estimator of t, was negative or greater than 10°, 
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Coverage Probabilities and pier of 95% Confidence Intervals 
Population I Population II 
P ~ 9.05, p, ~ 0.01 P, ~ 9.01, p, ~ 0.002 P, ~ 0.05, p, ~ 0.01 P, ~ 9.01, p, ~ 0.002 
Bootstrap Wald Bootstrap Wald Bootstrap Wald Bootstrap Wald 
cp a cp T cp T cp T cp a cp T cp iE cp is 


a NC NG. .0.95 129 NC NC iy, 0.04 398 NC NC «1.0.93 127 NC NC 0.76 400 
it NC NC 0.95 1,044 NC NG 0,907,838" NC INC ee oe 95 a omebs 029 NC NC 0.90* 7,764? 
7M NC ING ODS) E052 NC NC 0.90% = 8,200° NC NG isn 0.95, 44,037, NC NC 0.90* 7,784" 
ty 0.95 1307) 0.95 129) ire 0.92 399 0.94 404 0.97 147. 0.95 137; «0.96 642 ~=—0.92 657 
top 0.94 1,110 0.95 1,044 0.74 Lip 019907 9:8,181% 4):0:94., 91,129 90,959 9:1,029)4. 0.74 L, 0.90° 7,764* 
> O94 oA Si., ' 10:95 cc 14052.v O75 Leds 0905 583201" 0954 01139) O96 mn OSS eumOns Liyw 0.20 erie8 19s 
3 0.94 [3d et0:95 129 }.=..0.92 Al2 094% GeA03 . 0.97 150 =: 0.94 137 poW.97, 668 0.93 657 
od O94 ALG <p} O95) 15049. (072 oe? 0.8085 6:887> O94) VIS ™ O95 “O28 073 Ly 0.897 6,735, 
zu 0:94,» )15124-.y' 0.95". 1,057 «| ), 0.73 Leth O90 pG;908" » 0:95) 113139. 0.95- 1,038... 077 L, 0.90" 6,796" 
ty 0.95 1315) 4, 0.95 1287 0,93 412 0.94 402 0.96 151 MOOS LSP NL0,96 666 0.92 652 
tS 0.93 1,043 0.94 O98 WO. Soin S402 Or dnesl42 ‘0.93: L057, 0.93 985... 0.60 3,074. 0.72 53:095 
*/ O93 pa iOS2 yi QLOA se LOOT anen0). 60K eae OO.- V0.9 tia 38178 | 004 11072, tg 093 995. %0.684543.210.4 40. 3 aeaeskss 
aP 0.94 Sinn 095 L290 bets091 411 0.94 402 0.89 15h 0.95 13 Fey 4 0:86 666 ~=0.93 654 
tS 0.97 997e, 0,95 Siluarl OO, 1,506' 4,092 15573 1097 sa l000)., 0.95 943, sp OO oI SLi “OOZ naib 
a O97 45 1d,006, ninO95 966 i 100K 1575 10.94 01024 0.97. 1,011 | 0.95 953° 1:00. 1679") (0.95 iano 
Notes: cp, coverage probability; 7, average length. Superscripts Mand D of the MLEs t,t, and 7 indicate model-based and design-based 
confidence intervals, respectively. Bootstrap confidence intervals computed on 2,000 bootstrap samples. NC, not computed. Results 


based on 10° trials. Superscript a indicate results obtained aby. ignoring 8% of the trials. Ignored trials were those in which the 
corresponding estimator of t, was negative or greater than 10°. L; and Ly indicate lengths greater than 10° and 10%, respectively. 


Relative Biases and Square Roots of aia Square Errors of Variance Estimators 
Population I Population II 
P, = 9.05, p, = 0.01 P, ~ 9.01, p, ~ 0.002 P, * 9.05, p, = 90.01 P, = 9.01, p, * 0.002 
Bootstrap Taylor Bootstrap Taylor Bootstrap Taylor Bootstrap Taylor 


rp re? rp re? rB re” rp re” rp re” rp re” rp re’ rp re? 
ae NC NCAT OOM OAT NC NC -—0.04 0.08 NC NC -0.20 0.31 NC NC —0.64 0.65 
aM NC NC 0.01 0.49 NC NC OF ye5.37 NC NC -0.02 0.64 NC NC Ke )ptisAt 
si NC NGiny $0.01" 0:48 NC NC Le itd. NC NC -0.02 0.64 NC NC LT” wm Sa3e 
nf 0:03); O19.0 0.01) 0.174 0:02)" 0.17, 1=-0.00;.. 10.17, 0.08), 0.46. =0.075) 1 0.28. =0.05 1040.00] 1.037 
a O16, 61 9.623)); (0.05 40.49 L, L, O53, Mt OO meek: 10, ¢=0:02 i064 L, L, bs irate 
ih OAS pen0.6). 40.04), 0:48 L, L, 1:07 535-4 0.2000, oh. 10 yes 010247 064 L, L, yy aati? 
ty 0.02 fh 0:20, = OO ]i8 1 O.UTie up O03; ey0. L995 = 0-01 aii 2 017), gi Or 14s OS Log 01062 et 0:28) 9005); 5 OS TeeeOOR 0:37 
od 0.13 0.62 -0.01 0.49 0.24 1.20 Le oy 4.65 Wi 022-9 0,920), 2-0, 00% O62 O: 30g el AG h6fr) «6.4% 
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Notes: rf, relative bias; re”, relative mean square error. Superscripts M and D of the MLEs 7,,7, and t indicate model-based and design- 
based variance estimators, respectively. Bootstrap confidence intervals computed on 2,000 bootstrap samples. NC, not computed. Results 


based on 10° trials. Superscript a indicate results obtained {bY ignoring 8% of the trials. Ignored trials were those in which the 
corresponding estimator of t, was negative or greater than 10*. L; and Ly indicate values greater than 10° and 10°, respectively. 
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On Sample Survey Designs for Consumer Price Indexes 


Alan H. Dorfman, Janice Lent, Sylvia G. Leaver and Edward Wegman ' 


Abstract 


Survey sampling to estimate a Consumer Price Index (CPI) is quite complicated, generally requiring a combination of data 
from at least two surveys: one giving prices, one giving expenditure weights. Fundamentally different approaches to the 
sampling process—probability sampling and purposive sampling—have each been strongly advocated and are used by 
different countries in the collection of price data. By constructing a small “world” of purchases and prices from scanner data 
on cereal and then simulating various sampling and estimation techniques, we compare the results of two design and 
estimation approaches: the probability approach of the United States and the purposive approach of the United Kingdom. 
For the same amount of information collected, but given the use of different estimators, the United Kingdom’s methods 
appear to offer better overall accuracy in targeting a population superlative consumer price index. 


Key Words: Elementary index; Probability proportional to size sampling; Purposive sampling; Scanner data; 


Superlative index. 


1. Background 


From start to finish, survey sampling for the sake of a 
Consumer Price Index (CPI) must rank among the most 
complicated of sampling enterprises. The population target 
is hard to pin down, the appropriate domain of items 
debated, the definitions of the raw ingredients — prices, 
quantities, items — ambiguous and subject to question. The 
ultimate estimator—the estimator of the all-items CPI- relies 
on data from at least two surveys, one giving prices, and one 
giving “weights.” Below the level of “composite items” (or 
“item strata”) — groups of items supposed homogeneous in 
their price movements — there is typically no cost effective 
way to keep sampling weights up to date. Debate therefore 
goes on about the proper choice among various simple 
alternative estimators of price change for item categories, 
the “elementary aggregate indexes.” The appropriate meth- 
od of aggregating these price changes, using the weights, is 
subject also to debate. 

There are two broad approaches to the sampling by 
which prices are collected: probability sampling and 
judgment sampling. The most commonly accepted approach 
to survey sampling in general requires injecting an element 
of randomness into the survey process and relying on this 
randomness to make inference about population charac- 
teristics of interest — probability or “design-based” sam- 
pling; see, e.g., Sarndal, Swensson and Wretman (1992). 
This approach was not always taken for granted. Early in the 
20" century, “purposive” or “representative” sampling was 
considered a viable, and possibly better, option. More 
recently, the prediction-based school of Royall has chal- 
lenged design-based assumptions; see e.g., Valliant, 
Dorfman and Royall (2000). 


In the U.S., all CPI-related surveys are carried out using 
complex probability sampling techniques. Around the 
world, most CPI’s are constructed from judgment samples, 
in which experts on the different item strata choose broader 
or narrower classes of items for which field representatives 
collect prices. The fundamental reason for this is the diffi- 
culty of getting all the data one needs on the plethora of 
items sold, and the places where they are sold, to make 
probability sampling feasible. 

The interesting fact is that there has been very little 
assessment of the relative accuracy of the different ap- 
proaches to sampling. Indeed it has not been clear that it is 
feasible to make such assessments. The underlying popu- 
lation price index, for even the smallest of countries, 
involves so many transactions on so many items in so many 
places as to be inaccessible. Moreover, the population of 
items on the market is in a constant state of flux, com- 
plicating the application of traditional population index 
formulas. How then can one judge the relative closeness to 
“truth” of different sample-based estimates? Furthermore, 
in most cases, not even sample information is available for a 
key ingredient of the population index-namely the quantities 
of items sold — so even artificially constructing a population 
for test purposes from sample data has not been feasible. 

The relatively recent availability of scanner data, in the 
U.S. and elsewhere, presents an unprecedented opportunity 
for testing sampling approaches and estimators. These data 
include prices and quantities, typically on a weekly basis, of 
all the items sold in a given category within a large sample 
of outlets having scanner devices. Such data may be used to 
construct realistic populations of transactions for which the 
true price index is known. We can then use various methods 
to sample from this population, construct different index 


1. Alan H. Dorfman, Office of Survey Methods Research, and Sylvia G. Leaver, Office of Prices and Living Conditions, U.S. Bureau of Labor Statistics, 2 
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U.S.A., 20590; Edward Wegman, Center for Computational Statistics, George Mason University, Fairfax, VA, U.S.A., 22030. 
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estimates of interest, and compare the results to the known 
population parameters. One such study, described by 
de Haan, Opperdoes and Schut (1999), seems to show that 
“cutoff sampling,” the sampling of the few largest (in terms 
of revenue generated) items in the population, outperforms 
two important design-based approaches: simple random 
sampling (srs), and probability proportional to size sampling 
( pps) (where the size measure is, again, revenue). 

One difficulty in any study making such comparisons is 
the task of maintaining a “level playing field.” If one 
sampling method, for example, makes use of (population) 
information that might not actually be available in practice, 
while another does not, the comparison of methods is 
undermined. Similarly, if one method provides only one 
sample or very few samples, and another provides thou- 
sands, special precautions are needed in comparing the two; 
indeed, such a comparison might require serious qual- 
ifications. Given the complexity of the sampling and esti- 
mation methods used in price index computation, it is not 
surprising that these and many other difficulties complicate 
experiments designed to compare various methods. 

Ideally, to compare the approaches, for example, of two 
countries, we would mimic the whole complex sampling 
and estimation process of each and evaluate its costs. Both 
processes would be allowed the same budget, and we would 
be able, by some predetermined and equitable measure, to 
evaluate each estimate’s proximity to a known target index. 

This paper comprises two studies, a large primary study, 
and a smaller secondary, follow-up study. 

The main study is described in Sections 2 through 4. 
Section 2 describes the construction of the target population. 
Section 3 describes the “US” and “UK” methodologies and 
outlines the simulation details. No attempt is made to assess 
relative costs (thus falling short of the ideal), but the 
competing approaches are made as equal as possible in 
terms of the information they use. Results, which favor the 
UK approach, are given in Section 4. 

The follow-up study, in Section 5, attempts to disen- 
tangle the effects of different components of the two 
approaches, in particular sampling method and elementary 
index formula. Section 6 gives a final summary and 
discussion. 

Note on the target indexes. The price index literature 
contains myriad formulas for calculating price change 
between one period and another. Different indexes are 
compatible with different assumptions regarding the “‘aver- 
age” consumer’s buying behavior in response to price 
change. The “fixed market basket” indexes, the commonly 
employed Laspeyres and less used Paasche formulas, are 
compatible with the assumption that consumers continue to 
purchase the same items in the same quantities regardless of 
changes in relative prices. The Laspeyres index projects the 
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period 1 (“base period’) quantities forward to period 2 
(“current period”), while the Paasche applies the period 2 
quantities to period 1. The geometric index (or “Jevons” or 
“geomean’), usually weighted with base period expenditure 
shares, assumes that consumers adjust the quantities they 
purchase in such a way that the expenditure share for each 
item remains constant across time. The “superlative” Fisher, 
Tornqvist, and Walsh index formulas, which rely on 
quantity (or expenditure share) information for both periods, 
do not require these assumptions. Formulas for these 
indexes, with a superscript y representing the base period, 
y+l1, the current period, and i the item purchased, for the 
indexes are given in Appendix A. 

The debate on the all items target index usually comes 
down to choosing between the Laspeyres and one of the 
superlative indexes. Most countries select a Laspeyres target 
index, but a strong case (Diewert 1997) can be made that the 
proper target is a superlative index (usually the Fisher or 
Tornqvist), even if the formula for the estimator does not 
resemble one of the superlative population index formulas. 
Because of the form of the US elementary aggregates — 
geometric mean-—and the fact that previous research 
(Dorfman, Leaver and Lent 1999) indicated that the lowest 
level of estimation can have a major impact, the weighted 
geomean will be included among the potential targets. 
Targets for a given domain are calculated based on prices 
and quantities of all items in the domain following the 
formulas in Appendix A (a single-stage aggregation of 
prices and quantities). 

Note: These formulas are deceptively simple, requiring 
the notation of section 3 for their full development. Thus, in 
a formula such as that for the Fisher index F' (which we will 
take as our target in the main study of sections 2 — 4) “7” 
represents an item 7 belonging to a small class c (an “ELI” 
or “representative item’ — see section 3), where c is itself a 
subset of wider classes; further, the item 7 is sold in a 
particular outlet 7, classified as part of a particular chain k, 
and located in a particular sampled geographic area, the 
primary sampling unit (psu) /. Thus, the expression for a 
sum >, in the case of the overall population index, is really 
shorthand for Yj, Lies dpece,t) Ves Lgad Dives Dmetreys 
a similar remark holds for [];. In short, these are sums and 
products over a// items in the population. Contractions of 
this full expansion will give the population indexes for the 
different classes C, efc. 


2. The Population for the Primary Study 


The data source for the present study is a scanner data set 
for breakfast cereal for the years 1995 through 2000 in three 
separate but contiguous sections of a single large 
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metropolitan area. The data set was purchased from the A.C. 
Nielsen Corporation by the U.S. Bureau of Labor Statistics 
for the purpose of determining the feasibility of incor- 
porating scanner data into the U.S. CPI; see Richardson 
(2000). 

From these data, artificial “populations” were drawn by 
the method described below. Thus the study encompasses 
an apparently narrow world, that of cereal, within a fairly 
restricted geographic domain. Even this restricted world, 
however, allows for rather discrepant price trends over the 
six years. Thus, although we will not be able to generalize, 
in any simple fashion, to global price indexes encompassing 
a wide heterogeneity of products, we may be able to derive 
important clues on the effects of different sampling methods 
and the behavior of particular estimators. 

The six years’ worth of data available provided the 
opportunity for establishing fairly long-term price trends. In 
order to keep the data manageable and avoid the compli- 
cations of seasonality, we limited ourselves to February 
data. For February of year y, for each item (i.e., each 
particular combination k of brand, type, size) in a particular 
outlet, four weeks ¢ of price and quantity data were 
combined into a single month’s price and quantity, by using 


the sum of quantities ¢;°"” = ycre,) 7, Sold during the 


month as the quantity, and the wnit value pj)’ = 
Drered, » We Pi / Dtered,y % aS the price. Unit values com- 
puted over short periods of time (e.g., a month) give perhaps 
the most meaningful sense of the “average” price for a 
particular item. The use of unit values smoothes the data and 
reduces it to more manageable proportions; for a discussion 
of circumstances under which use of unit values is appro- 
priate or not appropriate see Balk (1999). 

For the purposes of the study, the population of breakfast 
cereals was divided into four groups: 


1. Hot Cereals (77) 

2. “Sugary” cereals (S) 

3. “Fruity” cereals (7) 

4. “Plain” cereals (P), i.e., cold cereals not falling 
into categories (2) and (3). 


For each group, for each successive pair of years, super- 
lative and non-superlative indexes were calculated, using 
item-outlet combinations available in both years. In practice, 
there is generally a problem with getting perfect match-ups 
from period to period, and finding means to deal with this 
by finding substitutes for original products or by other 
means is important; this study bypasses this particular 
problem. 

Long range indexes (’95 to ’00) were calculated both 
directly and by chaining annual indexes. Additionally, 
indexes were calculated on the “core” items, meaning those 
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available in all six years. On a year-to-year basis, the core 
items represented between 53% and 61% of a given year’s 
items available for year-to-year comparison; core expen- 
diture was from 83% to 91% of the total expenditure on all 
(core and non-core) items. There were 326 core items, and a 
total of 848 distinct items over the course of ’95 to ’00. 

Values of year-to-year population indexes are repre- 
sented in Figures 1 through 5. Figure 1 gives the index 
I”*' values for Sugary cereals based on all items sold in 
stores in both y and y+l, for (February of) y= 
1995, ..., 1999 (the “all items’). Values for five indexes 
are shown, including the Paasche P and, as being of 
academic interest, a unit value index U, the ratio of 
quantity weighted mean prices, averaged over all item types 
and outlets. Figure 2 gives results of the same calculations, 
but limited to “core” items. Figures 1 and 2 are almost 
identical, and the resemblance between indexes calculated 
using all items and those using just the core items held for 
the other cereal categories as well. Figures 3 through 5 give 
the results for the core-based indexes for Hot, Fruity, and 
Plain cereals. For any given index, the figures indicate 
serious differences across cereal categories. The price trends 
of the four major groups are quite different: H increases, S 
decreases sharply, / decreases modestly, and P increases 
modestly. 

Table 1 gives long range (95 — ’00) direct indexes and 
chained indexes for “all items” and “core items.” (“All 
items” for constructing an index between two given years, 
are all those item/outlets with positive quantities sold, both 
years). Again, there is very little difference between the 
values for “core items” and “all items,” and sharp differ- 
ences from one cereal category to another. The chained and 
direct results are close for the superlative indexes but tend to 
be discrepant for the geomean, Laspeyres, and Paasche. The 
chained and direct unit value indexes are close and in fact 
the latter would be identical to the chained based on the core 
items, except that, for convenience, the year to year indexes 
were based only on item-outlet combinations available for 
both years. 

Except for some oscillation of position of the unit value 
index, we observe a clear ordering of index values by 
formula, the same across categories, which may be summa- 
rized as follows: (1) The superlative indexes differ relatively 
little from each other, a noteworthy result given the amount 
of variability in the item-outlet price relatives and quantities, 
due to “sales.” (2) The traditional non-superlative indexes 
differ wildly from each other and the superlatives, with the 
geomean, weighted by first period expenditures, running 
much higher than the superlatives, the Laspeyres still 
higher, and the Paasche (not surprisingly) much lower. 
These results suggest that, in Cereal World, not only 
quantity, but expenditure share, tends to drop in period 2 on 
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an item having a sharp increase in price in that period. (3) 
The unit value index is low as well, but, except in the case 
of Hot cereals, is better than the tradional non-superlative 
indexes in approximating the superlatives. (4) In the light of 
later developments in this paper, and at the suggestion of a 
referee, two non-quantity based indexes are included in this 
table (although not in the figures): the dutot index, which is 
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a simple ratio of average prices (RA) — see Appendix A, and 
an unweighted (that is, constant weighted) geomean; both 
are usually reserved for computing indexes at the elementa- 
ry level. The results are surprising: in approximating the 
superlatives, they do as well as or better than the traditional, 
quantity based non-superlatives, about on a par with the unit 
value index. 


1995 1996 1997 


1998 1999 2000 


Index 


Index 


Year 


—@— Geomean —-~ Paasche —*&— Térnqvist —><— Fisher —X— Laspeyres —@— Unit Value 


Figure 1. Annually Chained Population Target Indexes for All Sugary Cereals February-to-February Indexes, 
1995 = 100. 


1995 1996 1997 1998 1999 


Year 


—*— Geomean —#%- Paasche —*— Térnqvist ~<— Fisher —>*— Laspeyres —®— Unit Value 


Figure 2. Annually Chained Population Target Indexes for Core Sugary Cereals February-to-February Indexes, 
1995 = 100. 


1995 1996 1997 1998 1999 2000 


Year 


—@@— Geomean —i— Paasche —&— Térnqvist —><— Fisher —— Laspeyres —®— Unit Value 


Figure 3. Annually Chained Population Target Indexes for Core Hot Cereals February-to-February Indexes, 
1995 = 100. 
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1995 


1997 


1998 


Year 


1999 


—®— Geomean ~—®i-Paasche ~~#&~ Térnqvist —<— Fisher —*K—Laspeyres —®—Unit Value 


2000 


Figure 4. Annually Chained Population Target Indexes for Core Fruity Cereals February-to-February Indexes, 


1995 = 100. 


1995 
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1998 


Year 


1999 


—®—Geomean ~*~ Paasche --#%-~ Térnqvist ~<~ Fisher —*—Laspeyres —®—Unit Value 


2000 


Figure 5. Annually Chained Population Target Indexes for Core Plain Cereals February-to-February Indexes, 


1995 = 100. 
Hot Direct 
Chained, All Items 


Chained, Core Items 


Sugary Direct 
Chained All Items 


Chained, Core Items 


Fruity _ Direct 
Chained All Items 


Chained, Core Items 


Plain Direct 
Chained All Items 


Chained, Core Items 


Fisher 
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1.1216 
11221 


0.7898 
0.7771 
0.7704 


0.9296 
0.9696 
0.9328 


0.9816 
1.0053 


Table 1 

Direct and Chained Indexes for ’95 — ’00 

Geometric 
Mean Paasche T6rnqvist 
1.1176 1.0253 1.0847 
1.1801 0.9874 1.1159 
1.1804 0.9865 1.1160 
0.8855 0.6739 0.7913 
1.3341 0.3825 0.7925 
1.3591 0.3661 0.7849 
0.9716 0.8676 0.9319 
1.2202 0.6849 0.9661 
1.1808 0.6557 0.9320 
1.0811 0.8641 1.0045 
1.3969 0.6330 120338 
1.4234 0.6175 1.0353 


1.0054 


Laspeyres 


1.1569 
1.2742 
1:2763 


0.9257 
1.5786 
1.6212 


0.9960 
1.3728 
1.3269 


P15 0 
hfe) 
1.6370 


Unit Value 
0.9576 
0.9453 
0.9759 


0.7417 
0.7506 
0.7585 


0.8932 
0.9308 
0.8950 


0.8554 
0.8935 
0.8879 
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Table 1 
Direct and Chained Indexes for ’95 — ’00 

Geo- Geo- 

metric Las- Unit metric 

Mean* Paasche Tornqvist Fisher peyres Value RA Meant 

Hot Direct 1.1176 10253 1.0847 1.0891 1.1569 0.9576 1192 1.0949 
Chained, All Items 1.1801 0.9874 dls iets) 1.1216 1.2742 0.9453 E1393 PS 
Chained, Core Items 1.1804 0.9865 1.1160 P22] 1.2763 09759 1.1374 Liisi 

Sugary Direct 0.8855 0.6739 0.7913 0.7898 09257) 0.7417 0.8817 0.8702 
Chained All Items 1.334] 0.3825 0,7925 OUT tl 1.5786 0.7506 0.9124 0.9010 
Chained, Core Items 1.3591 0.3661 0.7849 0.7704 16212 0.7585 0.8984 0.8894 

Fruity Direct 0.9716 0.8676 0.9319 0.9296 0.9960 0.8932 0.9815 0.9726 
Chained All Items 1.2202 0.6849 0.9661 0.9696 1.3728 0.9308 1.0263 1.0165 
Chained, Core Items 1.1808 0.6557 0.9320 0.9328 1.3269 0.8950 0.9935 0.9820 

Plain Direct 1.0811 0.8641 1.0045 0.9816 1.1150 0.8554 1.0620 LOS 
Chained All Items 1.3969 0.6330 1.0333 1.0053 965 0.8935 1.0642 1.0572 
Chained, Core Items 1.4234 0.6175 1.0353 1.0054 1.6370 0.8879 1.0653 1.0571 


* Weighted by base period expenditure. 
+ Unweighted. 


Based on this preliminary investigation, and for relative 
simplicity, we restricted our further investigations to the 
core data. To investigate the relative accuracy of probability 
and purposive sampling, as applied in practice to construct 
CPI’s, we endeavored to approximate the sample designs 
used by the United States and the United Kingdom- 
representing probability based and judgment sampling 
respectively. In both cases we were fortunate to have 
detailed information on the complex survey processes, in the 
form of manuals, and contacts within the respective 
agencies. The basic idea was to repeatedly sample from a 
given population, for example the core transactions in the 
years ’95 and ’96. Each “run” was a composite of sampling 
and estimation activities carried out according to the 
methods of one country or the other. It should be borne in 
mind that our interest was in comparing the merits of 
methodologies, not in measuring the success of the US and 
UK in estimating their target population parameters. 

The four “natural” population groups described above, 
referred to as “Major Groups” in the UK and “Expenditure 
Classes” in the US, were divided into finer sub-groups. In 
practice, sub-groups would be defined in terms of types of 
commodity. One justification for this, besides any intrinsic 
interest there might be in those commodities themselves, is 
that sub-groups so formed will tend to be homogeneous in 
their price trends. For purposes of this simulation study we 
therefore defined sub-groups as follows: 
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1) Long range price change for each of the 326 items 
in the core data were calculated, using unit value 
indexes for the items (across outlets) for °00 versus 
a8h 

2) Noise was added to these indexes, items within a 
major group were sorted by their values of the 
perturbed index, and adjacent items were grouped 
together. The grouping of items with close long term 
indexes was to make the subgroups homogeneous, and 
the addition of noise was done so that the homoge- 
neity would be realistically imperfect. 


Table 2 gives the population item structure that was 
constructed, including the nomenclature in use in each of 
the two countries, the number of groups at each level of 
refinement, and the corresponding symbol for each class 
level used in this paper. The “Representative Item” is the 
lowest level at which an index is produced in the UK. This 
corresponds to the US’s Entry Level Item (ELI), actually a 
collection of similar or related items. In the US, indexes are 
produced for categories one level up, ie., at the “Item 
Stratum” level, but these categories are further divided by 
the geographic areas in which the items are sold. Note that 
there are 2 or 3 Item Strata/Sections / in a Class/Major 
Group C, 3 ELlI/Representative Items c per Item 
Stratum/Section / (except in one instance 2), and 10 or 11 
items/varieties 7 in each ELI/Representative Item c. (Note: 
an actual UK class might be larger or smaller than the 
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corresponding US class; for example as a rule the ELI 
probably takes in more sorts of specific items than does the 
Representative Item. We had to force equivalence to ensure 
that the same amount of information was used in each 
approach. This adjustment will not affect our conclusions 
regarding the relative merits of the basic methods used in 
the two countries). 


Table 2 
Population Structure of “Cereal World”: Items 
Number of 
UK US Groups Symbol 
Major Group Expenditure Class 4 G 
Section Item Strata 10 h 
Representative Item Entry Level Item (ELI) 29 ‘6 
Variety Item 326 i 


In addition to the item structure, each population of 
transactions has a “spatial” structure, characterizing where 
an item was sold. This structure is summarized in Table 3. 
Outlets belong to chains (e.g., Safeway, Kroger), which cut 
across the three US geographic primary sampling units from 
which the cereal data were collected. (In the UK termi- 
nology, chains are called “multiples.) Outlets in a given 
chain share common ownership, with the exception of 
“Chain 8,” which was a “catch-all” group consisting of 
outlets not belonging to a major chain (there may have been 
some “mini-chains”). In matching this “chain structure” to 
the classification of shops used in UK sampling, Chain 8 
was considered a set of “independents” (the term used for 
independently-owned shops in the UK). Chain 4, which 
appeared to have the greatest homogeneity of pricing across 
outlets, was regarded as a “centrally collected multiple,” the 
term used in the UK for groups of outlets with centrally 
controlled pricing. Each remaining chain was a non- 
centrally collected multiple. The manner of collection and 
estimation for each of these three types is given in the 
description of UK methodology below. 

Thus the population consists of N° ~ 20,000 records for 
95 — °96 indexes, each record representing the purchase of 
an item i within an outlet 7. Attached to each item/outlet 
are its PSU/Region /, its chain/shop-type k, the 
outlet/shop j, the item/variety i, the ELI/representative 
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class/major group C, and p’, qg’, p’”', and gq’, the 
prices and quantities (in ounces) of the items sold in 
(February of) the two years in question. We used this 
population file (henceforth referred to simply as “the file’) 
to simulate all phases of the US and UK operations. 


3. Sampling Methodologies Simulated 


The complicated sampling procedures we used to 
simulate the US and UK approaches are patterned on the 
respective practices of these two countries. These practices 
change over time, and have variants even at a given point in 
time. Our goal was not to determine which country does 
better, nor to encompass all variants. Rather it was to 
compare two distinct modes of sampling, with the range of 
complexity those modes entail. The interested reader can 
find a description of the US construction of the CPI in the 
BLS Handbook of Methods (2005), Chapter 17. For the 
UK’s Retail Price Index (RPI), we relied on The Retails 
Prices Index Technical Manual (1998). A description of 
more current UK practice can be found in the Consumer 
Price Indexes Technical Manual (2005). 


3.1 US Sampling Methodology 


We first describe the US sampling methodology, which 
requires three surveys employing probability sampling: (1) a 
household survey, the Consumer Expenditure Survey 
(CEX), to estimate household allocation of expenditure to 
different categories of goods, (2) a second household 
survey, the Point of Purchase Survey (POPS) to estimate, 
within item groups, the relative amounts spent in different 
outlets, and (3) an outlets survey, through which individual 
items are selected and priced. In all three cases, sampling for 
the simulation is random with replacement (though the 
sampling employed in practice is considerably more 
complicated). The first two surveys are based on simple 
random samples, and the last is based on a probability 
proportional to size (pps) sample, where the size measures 
are a function of expenditures as estimated from the CEX 
and POPS. The sample for the third survey is a collection of 


item c, the item stratum/section hf, the expenditure — items within outlet/ELI combinations. 
Table 3 

Population Structure of “Cereal World”: Outlets 
UK US # Symbol 
Region Primary Sampling Unit 3 l 
Shop type: Independents Chain 8 k 

, Central Chain 4 

Multiples: 
Non — central Chains 1-3; 5-7 

Shop Outlet ~300 fj 
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3.1.1 CEX (Household Survey) 


The goal is to estimate £,,, the gross household 
expenditure on ELI c within PSU /. We sampled using 
simple random sampling with replacement (srswr) from the 
file described above, within PSU, in such a manner as to get 
unbiased expansion estimates 

95 
ee, 
Nyy jels(xl) iecrs(xl) 


where Ej, = dij; Piis N ;°> was the population size (number 
of records for psu / in’95 — 96), and 7, was the sample 
size of the CEX sample s(x/) in PSU /, chosen to match 
actual US CEX sample sizes and to achieve coefficients of 
variation of the estimates that approximated those achieved 
through the actual US CEX; the x in s(x/) and n,, 1s 
meant merely to differentiate the CEX from the POPS 
survey (which has a corresponding “ p ”; see below) or the 
prices survey. This “imitation CEX” was a simplified 
version of the actual survey. Our methodology tacitly 
assumed that all customers in a given outlet bought items in 
the same proportions; it did not allow for the inevitable 
measurement error that accompanies any actual expenditure 
survey, and (for ’95 — ’96) it was too current: real CEX data 
often predate by several years the outlet surveys for which 
they are used. Since, however, the “household data” 
collected were used in the corresponding UK methodology 
(see below) as well, the simplified version sufficed for the 
intended comparison of methodologies. 

Higher level expenditures were estimated by simple 
addition. Thus, for example, the total expended across 
PSU’s in a given ELI c is estimated by E” =>) E;, etc. 
There were 500 CEX samples taken, each producing a 
corresponding set of expenditure estimates. 


3.1.2 POPS (Household Survey) 


Here the goal is to estimate the distribution of 
expenditures at different outlets for particular classes of 
goods. These classes could be ELI’s or groups of ELI’s; in 
the present study we assume they are the ELI’s. The actual 
US TPOPS (Telephone Point of Purchase Survey) is, as its 
name suggests, conducted by phone, using a sample rotation 
scheme with a four-year cycle. We endeavored, as we did 
with the CEX, to match statistical properties of our 
procedure to the actual TPOPS, but it turned out that to 
match sample sizes on our file of 20,000 would have given 
larger than desirable sampling fractions within PSU’s. We 
therefore cut the sample sizes in half —our “imitation 
POPS” should have precision about 1/2 of the actual 
TPOPS. Again, this modification will not affect the 
conclusions of this study, because we used the identical data 
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in the UK construction. Samples s(p/) of size n,, were 
drawn by srswr, and estimation was by the expansion 
estimator: 

ip aN oS Ppa 


io ici" 
Dy) iecas( pl) 


Since the POPS survey tends to be more up-to-date than 
the CEX, we allow y to be the base year of the index, 95 in 
95 — ’96, but 96 in ’96 — ’97, etc. There were 500 runs 
and sets of estimates, each to be matched with a CEX run. 


3.1.3 Outlet Sampling 


For each year y, selection of items from which to collect 
prices involves the following steps: 


(a) For each PSU /, and each of the 10 item strata h, 
we select 2 ELIs c by probability proportional to 
size with replacement sampling ( ppswr), with size 
measure E,° derived from the CEX. 

(b) For each ELI c selected, we select 8 outlets 7 by 
ppswr, using as size measure POPS expenditure 
estimates Bi. Thus altogether there are 160 ELI- 
outlet pairs per PSU, and 480 total, with a certain 
amount of repetition possible. 

(c) Within outlet/ELI (j, c) we “go” (as the field 
representative would literally go) to the outlet and 
“list” all items belonging to the ELI and their 
corresponding first period expenditures £;,,,, and, 
with this within-outlet frame, sample | item by 


Pps. 


For each item so selected, we record the prices 
Pijncis Y =1, 2. Thus we note that all aspects of the outlet 
sampling are pps with replacement, based on estimates of 
expenditure from one or other of the 2 household surveys or 
from within the selected store. Again, we performed 500 
runs, each run corresponding to a single CEX/POPS run. 


3.2. US Estimation 


“Elementary aggregates” / }:¥*1 index estimates at the 
PSUx Item stratum level, are the building blocks from 
which the CPI is constructed. In most CPI’s around the 
world, the lowest level indexes are unweighted averages of 
one sort or another, as is the UK’s RA estimator discussed 
below, and expenditure data are only used to aggregate 
these to higher levels. In the US, the elementary indexes are 
basically Horvitz-Thomson estimators relying explicitly or 
implicitly on expenditure estimates from both the CEX and 
POPS. In recent years, the US has for most item strata 
adopted a geomean formula (see Appendix A), so that 
estimates at this level take the form 
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Jél,ieceh and (i, 7) €s. Note that the weights are not 
particular to the i” item; we omit the time superscripts for 
brevity. They are not simply equal to the reciprocal of the 
number n,, of sample items in /h, as sample unbiasedness 
considerations might lead one to expect (Balk 2003), 
because the sampling probabilities do not reflect exact base 
period expenditures on items; see the BLS Handbook of 
Methods (2005). 

Then the elementary indexes are aggregated using 
estimated expenditures from the CEX according to a 
Laspeyres formula, for example 


sy ae 
De En ti 


T 1 1 
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A 


lh 
Ss E lh 
1 
to get the index for a given item stratum h, across PSU’s. 


3.3 UK Sampling Methodology 


The UK, like the US, combines three components in its 
estimation methodology: (1) a household survey, the Family 
Expenditure Survey (FES), to get estimates of amounts 
spent on different item groups, (2) a shops survey, the 
Annual Retailing Inquiry (ARI) to get expenditure 
information by section and shop type, and (3) an outlet 
survey of shops, to select items for pricing. 


3.3.1 FES (Household Survey) 


The goal is to estimate expenditures £. for repre- 
sentative items c, and £, , expenditures for region/section 
combinations. For purposes of this study we will assume 
that the data for the US’s CEX and the UK’s FES coincide 
run by run, so there are, again, 500 FES data sets. Note that 
the UK does not aim at the more detailed estimates £, . 
which the US targets. 
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3.3.2 Annual Retailing Inquiry (Shops Survey) 


The goal is to get estimates of expenditures Ee by 
section and shop type. This is considerably broader than the 
outlet (shop) by ELI (representative item) that the US’s 
POPS seeks. We use the same data, for each of 500 runs, to 
construct the ARI estimates that we used to construct the 
POPS estimates for the simulated US CPI. 


3.3.3 Outlet Sampling 


Selecting items from which to collect prices involves the 
following steps: 


(a)A “judgment sample” of representative items c is 
selected within each section h. In the present 
study (only to allow for simulation), within each 
section, we select the two representative items with 
largest values of &,. Note two differences from 
the corresponding step (a) of the US method: (1) 
selection is uniform across all regions /; (ii) 
selection is not random, and, in particular, it does 
not allow for duplication of representative items. 
(Duplication can occur in the simulated US meth- 
od, due to with replacement sampling of ELI’s 
within item strata.) 

(b)The field economists select the shops in a 
particular locale in which to price a given 
representative item. Traditionally, this was srswor, 
after the field economist had constructed a frame 
of appropriate shops. More recently, selection has 
been by pps, where the size measure is floor space 
dedicated to the type of goods the representative 
item represents. Field economists do not draw 
samples of “centrally collected” items: in the case 
of a very large multiple, the price of an item is 
collected from the multiple’s central office, and 
taken to represent the price of that item in all shops 
in the multiple. In the present study we proceeded 
as follows: for each region / and representative 
item c, we selected 8 shops as follows: 

4 from non-central multiples 
(Chains 1, 2, 3, 5, 6, 7) 

1 from a central multiple (Chain 4) 

3 from independents (Chain 8) 


In each case, for simplicity, we used srs without 
replacement from shops having positive expenditure 
for the representative item. The number of shops in 
the UK (8 per representative item in each region) 
matches the number of “outlets” in the US; there are 
160 shop/representative item pairs per region, or 480 
in total. Note the following differences from the U.S. 
methodology: 
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1. Information on shop type is being used for 
stratification (and will play a role in estimation 
below). This information is available in the US 
sample but is bypassed in favor of the pps 
methodology. 

2. We are allowing the UK to have information 
about the presence or absence of the specific 
representative item c (equivalent to the ELI) in 
the list of shops before sampling, whereas the 
US only in effect knows of the existence of some 
ELI in the given item stratum. (This assumes a 
multiple ELI-to-POPS category mapping, which 
was typically the case until recently in US 
operations; the current version of ELI-to-TPOPS 
(telephone point of purchase survey) category 
mappings is | to 1; that is, an outlet frame is 
constructed for each individual ELI.) 


(c) Traditionally, for each representative item c, within a 
given shop, the field economist selects that variety i 
which he/she regards as dominating its sales—a 
judgment sample of the most consistently purchased 
variety. We formalize this as follows: 


1. For a given shop/representative item pair (/, c), 
we list all varieties i. 

2. For each variety, we find the minimum quantity 
q, = Min(q?, q}*') over two years. 

3. We sample the variety i with Max{q,}. 
This process, of course, requires more 
information than a field economist would have 
at the earlier time period (and again is not used 
in the US sampling described above) but may be 
regarded as providing a surrogate for the field 
economist’s appraisal of the relative continuity 
of goods sold. 


Note: It is convenient to refer to the combination 
of selecting an outlet by srswor as in (b), and an 
item within the shop as described in (c), as 
maxming sampling. 


3.4 UK Estimation 


Elementary aggregates for the UK were calculated by a 
Ratio-of-Averages (RA) formula within each cross- 
classification cell defined by region, shop type, and repre- 
sentative item This is basically an unweighted estimate, 
given for independent shops by 
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In the case of multiples, a weighted version of the above 
formula is used with expenditures by shop type, estimated 
from the ARI, providing relative weights of central versus 
non-central multiples. 

A countrywide index for representative items c in the 
sample (aggregated over shop types k and regions /) is 
then calculated by a Laspeyres type estimator: 


Ty, ytl _ ~ Ty, y+ 
f iz » by Wikhe Tike > 
ie SK 


where ceh, and wW,,,. is based on E%, from the ARI and 
E;> from the FES (using these time periods keeps 
information used the same between US and UK). Further 
aggregation (over representative items c) is done using E 
etc. from the FES. 


y 
ho? 


3.5 Comparison 


Table 4 gives a summary comparison of the two meth- 
odologies, US and UK, that we have been considering. The 
predominant feature of the US method is strict probability 
sampling and estimation, typically ppswr; that of the UK is 
selective sampling, taking the most important item or 
category as judged by expenditure or quantity sold. The 
methods of forming elementary aggregates are different, and 
the weights for aggregation in the UK are estimated at a 
slightly coarser level at the lower stages. 

Table 5 gives a summary of what might be considered 
the strengths and weaknesses of the US and UK meth- 
odologies. By the advantage of “brute strength,” which we 
attribute to the UK approach, we mean the capitalizing on a 
combination of two factors that often play a role in pricing 
and price index construction. In the first place, market 
leaders tend to dominate the price scene; for example, if 
they sharply lower or raise prices, their lesser competitors 
selling similar goods may think it necessary or warranted to 
follow suit. Secondly, even if there is variation in the price 
trends among similar goods, the leading sellers are likely to 
dominate the price index by virtue of large expenditure 
values, that is, because of their correspondingly large 
weights. 
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HH Exp. Survey 
Outlet Exp./Category 


select item categories 


select outlets 


207 
Table 4 
Summary Comparison of US and UK Methodologies 
US UK 
9 BS, 69 


HH(POPS) £?. 


2 ELI’s c/item stratum h/PSU / 


Ppswr Ce vEr) 
8 outlets //ELI c x PSU / 


Shops Survey (ARI) £%, 


2 rep. items’s c/section h/Region / 
largest (E°/ E?>) 


8 outlets j/rep. item c x Region 1— srs 


ppswr (Ej, /E}.) within shoptype k, E}. > 0 
item within outlet/category 1 item i/jc pps (Ey ER.) 1 variety i/jc max[Min(q : q r+) 
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Table 5 
Comparison of US, UK Approaches 
Strengths Weaknesses 


US Gather more information 
More use of information 


Satisfies classical sampling theory 


Possible repetition in selection 
Ignores stratification of shops (that is, classification into chains) 


Gives regional (PSU) estimates 
Weighted estimators at 
lowest level 
More standardized operating 
procedure 
UK. Relies on “Brute Force” Patchwork of weights 
principle 
Stratification of outlets Inconsistent in Centralized pricing aggregation? 


Shops survey in field Uses variety of sources Unweighted and seemingly arbitrary estimator at lowest level 


4. Results of Primary Study 1) For the all-items, classes, and item strata, the US esti- 
mates appear to approximate the geomean G. This 
confirms what we have suspected from other work 
(Dorfman et al. 1999), namely that the lowest level of 
ageregation dominates (we used a Laspeyres formula 
for higher level aggregation). The fact that G lies be- 
tween the Laspeyres and superlative target provides 
some evidence that the US switch to this method of el- 


ementary aggregation was a step in the right direction. 


Indexes comparing ’95 to ’96 are given in Table 6, for 
the population (1) as a whole (the three areas combined), (2) 
broken down by classes/major groups, and (3) broken down 
even further into item strata/sections. Four indexes are given 
which might be taken as the targets of estimation. Recall the 
discussion on targets which concludes Section 1. 

Table 7 gives corresponding means, variances, and mean 
square errors for US and UK estimates, where the mean 
square error is computed with respect to the Fisher indexes. 
We observe the following: 


2) There appears to be no clear order relation of UK 
Section estimates to their corresponding targets; 
for example, the Section 11 index is higher than 
the target L, while the Section 12 index is lower 
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than the superlatives, efc. As we aggregate up to 
the Major Group and All Items levels, however, 
the estimates clearly begin to approximate the 
superlatives F or TJ. (Dalén (1998) noted a 
similar result in aggregating cut-off samples.) 


3) If we take the Fisher as the target, even at the 
section level, the root mean square error of the UK 
estimator is much lower than that of the US 
estimator. Given the relatively restricted nature of 
the UK sample design, it is not surprising that the 
UK estimator displays lower variance, but the form 
of the UK estimator would not lead one to expect it 
to unbiasedly approximate a Fisher index. 
Nonetheless, our results suggest that, at least for a 
population of purchases such as the one used in 
this study, the purposive, “brute force” methods of 
the UK (and many other countries) work well. 


Similar results were found for the succeeding pairs of 
years through 99 —’00. Figure 6 shows the all items year- 
to-year geomean and Fisher for five pairs of years and the 
means across samples of the corresponding US and UK 
estimators. (Note the difference in scale between Figure 6 
and Figures 1 through 5). It is readily seen that the U.S. 
estimator tends to track the population geomean. The UK 
estimator, tracking the Fisher, tends to overestimate in the 
later years, although it runs much closer to the Fisher than to 
the population geomean. It should be noted that we used 
increasingly out-of-date expenditure data, namely the ’95 
data, for purposes of sampling and estimation. It is possible 
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that outmoded expenditure data are having a greater impact 
on the UK estimates than on the US estimates, perhaps by 
leading us to oversample expensive representative items or 
to focus on some group of shops that are increasingly 
pricey. 

Results for the classes (“‘hot,” etc.) were very similar for 
the US vis-a-vis the geomean and are not shown. Figure 7 
shows the difference between the mean year-to-year UK 
estimates and the Fisher, for each of the four classes. It can 
be seen that the tendency to overestimate in the later years 
affects all four classes. 

Overall, the UK estimators provide better estimates of 
the superlative Fisher target than do the US estimators. 
Table 8 gives the ratio of UK root mean square error to US 
root mean square error, for all five pairs of years, for all 
items, for groups, and for sections. There are a few 
anomalous places, notably in the 98 —’99 indexes where, 
for section 2 of “hot,” and consequently for the entire class 
“hot,” the UK estimates are appreciably worse. In general, 
however, the UK methods provide much better estimates. 
This is due in part to a tighter sampling structure (mainly 
because purposive/cutoff sampling is much more restrictive 
than random selection of the set of items which can enter the 
sample), yielding, not surprisingly, less variance. In part 
though, as well, it is due to a surprising tendency of the UK 
estimators to target the corresponding Fisher indexes, 
reducing bias. Since the UK estimators do not formally 
resemble the Fisher index, the reasons for their tendency to 
approximate it merit further study. We turn to this issue in 
the next section. 


Table 6 
Potential Target ’95 — ’96 Indexes 
Description geomean Tornqvist Fisher Laspeyres 
All 1.053 1.002 0.997 1.079 
Classes/Major Groups 
1 — Hot 1.058 1.052 1.052 1.078 
2 — Sugary 1.042 0.964 0.956 1.072 
3 — Fruity 1.044 1.007 1.007 1.067 
4— Plain 1.069 1.027 1.027 1.092 
Item Strata/Sections 
Hot — 11 1.043 1.044 1.044 1.057 
Hot — 12 1.073 1.059 1.058 1.097 
Sugary — 21 1.003 0.917 0.910 1.034 
Sugary — 22 1.063 0.982 0.972 1.093 
Sugary — 23 1.093 1.052 1.054 LATS 
Fruity — 31 0.977 0.955 0.950 0.985 
Fruity — 32 1.165 PEG 1.116 1.204 
Plain —41 1.067 1.021 1.021 1.094 
Plain — 42 1.030 0.996 0.996 1.050 
Plain — 43 1.104 1.063 1.062 1.125 
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Mean 


1.002 


1.045 
0.971 
0.986 
12025 


1.064 
1.027 
0.850 
1.089 
1.026 
0.932 
MOT? 
1.060 
0.987 


Table 7 
Simulation Results for °95 —’96 Indexes 
WES: 
Description Target Index Mean Std. Dev. RMSE 
All 0.997 £057 0.016 0.062 
Classes/Major Groups 
1 — Hot 1.052 1.059 0.031 0.032 
2 — Sugary 0.956 1.046 0.030 0.095 
3 — Fruity 1.007 1.053 0.035 0.058 
4— Plain 1.027 1.072 0.025 0.051 
Item Strata/Sections 
Hot — 11 1.044 1.045 0.035 0.035 
Hot — 12 1.058 1.072 0.049 0.051 
Sugary — 21 0.910 1.004 0.050 0.106 
Sugary — 22 0.972 1.070 0.051 0.111 
Sugary — 23 1.054 1.095 0.044 0.060 
Fruity — 31 0.950 0.979 0.020 0.035 
Fruity — 32 1.116 1.178 0.084 0.104 
Plain — 41 1.021 1.069 0.050 0.070 
Plain — 42 0.996 1.033 0.035 0.051 
Plain — 43 1.062 1.107 0.042 0.061 
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Figure 6. Index Targets and Estimates for All Cereals February-to-February Indexes and Index Estimates, 
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Figure 7. Differences Between U.K. Estimates and Population Fisher Indexes February-to-February Indexes and 
Index Estimates, 1995 = 100. 
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Table 8 
Ratios of UK RMSE to US RMSE 
Description "95-96 "96-97 797-98 °98-’99 ’99-’00 
All 0.196 0.192 0.419 0.548 0.288 
Classes/Major Groups 
1 — Hot 0.713 0.517 0.483 1.437 0.589 
2 — Sugary 0.286 0.336 0.314 0.522 0.282 
3 — Fruity 0.595 0.508 0.308 0.501 0.405 
4— Plain 0.310 0.297 0.777 0.319 0.404 
Item Strata/Sections 
Hot — 11 0.923 1.066 0.682 0.529 0.508 
Hot — 12 0.920 0.850 1.169 1.860 0.842 
Sugary — 21 0.702 0.392 0.421 0.595 0.330 
Sugary — 22 1.092 0.426 0.380 0.341 0.365 
Sugary — 23 0.650 0.455 0.448 0.925 0.851 
Fruity — 31 0.778 1.059 0.637 0.581 0.618 
Fruity — 32 0.683 0.809 0.314 0.457 0.356 
Plain — 41 0.709 0.623 0.494 0.567 0.317 
Plain — 42 0.642 0.511 ia 1.092 1.005 
Plain — 43 0.678 0.839 0.641 0.815 0.701 


5. Follow-Up Study 


There are four aspects in which the approaches of the UK 
and US differ: (1) the stratification structure, in particular, 
the reliance of the UK on different shops strata and, to an 
extent, on centralized sampling, (2) the aggregation and 
weighting structure, (3) the mode of sampling at different 
stages, and (4) the formula for elementary aggregates. This 
makes it difficult to disentangle the extent to which each 
aspect is contributing to the relative merits of US and UK 
index construction. In particular, as noted in the last section, 
it is a bit of a mystery why, especially at higher aggre- 
gations, the UK index estimator tends to target the super- 
lative indexes. 

In our follow-up study we focus on the lowest level of 
index construction, that is, on (3), the shop-representative 
item (ELI) level of sampling and on (4), the formulas for the 
elementary indexes. We compare the relative merits of 
different options, taking the within area elementary indexes 
as our targets. Aggregation to higher level indexes will be 
carried out uniformly for all alternative lower level options 
considered, using the true population expenditure shares. 
The importance of the method of construction of the 
elementary indexes is widely recognized; see Diewert 
(2004) and references; also Dorfman etal. (1999). The 
example discussed in Appendix B, with results given in 
Table 9, illustrates the decisive effect that the lowest level of 
index construction has on the index as a whole. 

Thus, a likely important source of the difference in 
results of US and UK methodology lies in the sample 
estimation of the population elementary indexes. But this 
leaves open the question whether the differences arise 
because of differences in sampling method or in the 
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formulas used in estimation, or in both. Thus we are 
interested in determining: (1) how judgment sampling (in 
this case, cutoff sampling based on maxmingq) performs 
compared to probability sampling represented by ppswr, 
holding the estimator of the elementary indexes fixed, and 
(2) how estimators of elementary indexes compare when we 
keep the sampling method fixed. It will also be of some 
interest to determine what happens when maxming sampling 
is based on data from the base and previous time period, 
rather than the base and current period. 


5.1 Sampling Methods and Estimators at the 
Elementary Level 


To explore these questions, we carried out further 
simulation studies. The data were the same Cereal Data used 
in the primary study (successive Februarys), but limited to 
the Independent Shops, Chain 8. This was done to make the 
study more manageable but also because, for the other 
chains, the UK elementary index estimators were more 
complicated than the simple dutot. Also, it is reasonable to 
expect price behavior to be most heterogeneous in this 
chain, so that inherent differences will be clearer. Chain 8 
was the largest of the chains, comprising each year about 
30% of the whole population, approximately 6,000 records. 

The basic structure remained the same: 3 psu’s, 4 major 
groups/expenditure classes (hot, sugary, fruity, and plain), 
10 sections/item strata, and 29 representative items/ELI’s. 
For each ELl/representative item, 3 outlets (one item per 
outlet) were selected, as opposed to 10 in the primary study 
above. For investigating maxming based on previous time 
periods, the original 5 data sets, each using price and 
quantity data for a pair of years (°95/°96, °96/°97, etc.) were 
reduced to include only items that allowed “back matching”; 
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that is, matching across three years to compare prices of 
items in outlets for °95/°96/°97, °96/°97/°98, etc. About 90% 
of the Chain 8 records allowed back matching. (In 
considering the results below, it is probably worth noting 
that the sample reduction could disproportionately impact 
the back matched maxming). We shift our attention from the 
Fisher index to the superlative Walsh index, due to an astute 
suggestion of a referee, discussed in Appendix C. 

Three estimators were used for elementary indexes: the 
ratio of averages (RA) (the dutot), the unweighted geomean 
(also known as the Jevons), and the average of ratios (AR). 
In the pps sampling of outlets, and then in the sampling of 
items within outlets, the size variable (expenditure) was 
assumed known (rather than being estimated, as in the main 
study). Besides pps with replacement (as in the US 
approach), and maxming, we also investigated pps without 
replacement, on the suspicion it would be less variable than 
the with replacement version. 

For each mode of sampling, within each psu/ELI 
combination, we took 500 samples. We calculated the mean 
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square error of estimates with respect to a target ELI — level 
Walsh Index. Averages of mse across ELI’s were calculated 
for each mode of sampling/estimation, within each psu. 

Table 10 shows the ratio of these averages to the average 
mse for the maxming/dutot combination. For each estimator, 
for each psu, with one exception ( psu 3, °99/’00), maxming 
leads to lower mse, often by an appreciable margin. 
Sampling pps without replacement is second best. Holding 
the method of sampling fixed (comparing rows 1, 4, 7, then 
2,5, 8, etc. in Table 10), we note that with few exceptions, 
the dutot does better than the geomean, which does better 
than AR. These results suggest: (1) maxming is better than 
pps(exp), and pps(exp) is better than ppswr(exp). (2) The 
dutot is more efficient than the geomean, and the geomean 
is more efficient than an average of ratios. There is a 
beneficial synergism between maxming sampling and the 
dutot. Biases and variances were also studied, and the 
results (not shown) tended to follow the same pattern. 


Table 9 
Population Indexes ’95 — 96, Chain 8 
Description Laspeyres geomean* Fisher Walsh — Laspeyres of Walsh Elementary 
All 1129 1.091 1.028 1.030 1.040 
Classes/Major Groups 
1 — Hot 1.161 a 1.080 1.082 1.084 
2 — Sugary 1129 1.088 1.007 Lor 1.025 
3 — Fruity 1.084 1.054 0.997 1.005 1.015 
4 — Plain 35 1.101 1.046 1.042 1.050 
Item Strata/Sections 
Hot — 11 bol 57. ag EF 1.088 1.089 1.090 
Hot — 12 1.164 el'3 1.072 1.075 1.079 
Sugary — 21 1.086 1.045 0.962 0.970 0.992 
Sugary — 22 Lis 1.142 1.055 1.056 1.058 
Sugary — 23 Pel ley, 1.091 1.034 1.039 1.043 
Fruity — 31 1.003 0.992 0.949 0.965 0.966 
Fruity — 32 1.228 1.172 1.100 1.091 1.102 
Plain — 41 ae: 1.161 1.091 1.080 1.090 
Plain — 42 1.048 1.030 0997, 0.997 0.998 
Plain — 43 1.136 1.107 1.048 1.046 1.056 
* Weighted by base period expenditure. 
Table 10 
Standardized Average Relative Mean Square Error Across ELI’s, Reduced Populations, Chain 8 
psu 2 psu 3 psu 4 
estimator/sampling method °96-— 97 °97— 98°98 — °99 99 — °00 96 — ’97 97 — °98 ’98 — °99 799 — 00 °96 — °97 797 — "98°98 — 799 799 — 00 
dutot/maxming(UK) 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 1.00 
dutot/ppswor Kofi} 1.70 1.68 I 23 1.82 C335) 2.24 beep 1.06 le 0.93 
dutot/ppswr 23 2.10 191 2.14 1.42 2.10 1.46 2.67 1.45 1S 1.36 1.07 
geomean/maxming 1.20 1.16 1.16 1.06 1.06 1.14 1.08 1.05 1.10 Lid 1.42 0.96 
geomean/ppswor 2.08 1.88 1.98 DON, in33 1.94 1.47 DPSS) 1.33 1.09 1.28 0.97 
geomean/ppswr (US) 2.49 AY) 2.18 Jose 1.58 223 1.58 3.09 hese, 1.30 eS ipl? 
AR/maxming 1.42 {*32 1.31 1.14 1.24 1.03 1.30 1.05 Lit 1.20 je! 1.07 
AR/ppswor 2.81 DD 2.49 2.85 1.70 PES aT. 3.43 LS7 1.30 1.42 iba 
AR/ppswr Bhs) Decibel 2.66 3.08 2.03 2.58 1.87 3.96 1.83 1.49 1.66 1.30 
dutot/maxmingq, prior q’s 1.12 EN, LES 1.41 1.56 1.42 1.69 251 1.20 1.02 0.85 1.48 
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That the dutot sample index can target the Walsh 
population index (and hence indirectly any superlative 
index), when consistently largest sellers are sampled is, we 
suggest, the result of a very simple, “brute force” mech- 
anism: to the extent that the Walsh can be represented by a 
small sample of items, it is best represented by those with 
the consistently largest quantities, and it is these items that 
the maxming sampling scheme virtually always supplies. In 
Appendix C we discuss an alternative explanation for the 
good performance of the maxming/dutot combination. 

Average mean square errors were also calculated for the 
maxmingq/dutot combination based on previous values of gq, 
that is on q?', q?. Results are given in the last row of 
Table 10. There is an anticipated weakening compared to 
the updated maxmingq/dutot, but the results still compare 
favorably to the other options. We study this further in sub- 
section 5.2. 


5.2 Effect of Lagged Quantities on maxming 
Sampling 


To put the results of Section 4 in perspective, we need to 
inquire what the effect is of using lagged q’s in maxming. 
The reason is simple: although at first sight, using base and 
current period quantities seems the obvious way to capture 
the UK’s idea of persistent items, nonetheless, this involves 
using information (the current period quantities) which was 
not used in simulating US sampling. Perhaps this gives the 
UK methodology an unfair edge. 

We therefore compared the US approach, viz. ppswr 
(with size variable being base period expenditure) and 
geomean at the elementary level, with the UK approach 
represented by maxming —dutot, but now with maxming 
based on quantities q,_, and q,. Data sets were reduced 
slightly to guarantee that we would have matching data for 
three consecutive years. Aggregation to upper level indexes 
used actual population expenditures for both US and UK. 

Table 11 gives results for the All Cereals Indexes for 
chain 8, comparing biases, standard deviations, and root 
mean square errors with respect to the population Walsh. As 
expected, the results are not as good as those obtained by 
using current qg’s. Nonetheless, with respect to all three 
accuracy measures (bias, standard deviation, and root mean 
square error), the UK maxming/dutot combination still does 
better than the US approach representing probability 
sampling. 

For finer categories, Table 12 gives the ratios of mean 
square errors obtained under the UK method with lagged 
qs to those obtained under the US method. Although they 
are generally larger than those in Table 8, they still suggest 
that the purposive sampling approach of the UK is better. 
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6. Discussion 


We have presented a comparison of two fundamentally 
different approaches to sample design and inference for a 
consumer price index. The inescapable conclusion is that, in 
the population we studied, the “UK” approach, which 
involves tighter stratification and, more importantly, more 
restrictive judgment sampling within strata than the 
probability sampling of the “US” approach, does better in 
estimating a target superlative index. 

This is shown to be the case, whichever low level price 
index estimator (the dutot, or geomean, or the average of 
ratios) is employed, although the dutot (ratio of averages) 
performed best. 

The UK approach does better for two reasons: (1) its 
tighter sampling, restrictive of items selected (for example, 
see Table 13 described in Appendix C), leads, not 
surprisingly, to lower variance, an observation made already 
in de Haan et al. (1999), and (2) the dutot sample indexes 
target the superlative indexes under dominant market 
sampling, which was surprising and called forth the invest- 
tigation described in Section 5. On the other hand, the US 
approach yielded an index estimator which could be 
described as unbiased, but it was unbiased for the (wrong) 
population geometric index weighted by first period 
expenditure. Thus it tended to run considerably higher than 
the target superlative index (whether Fisher, Walsh, or 
Toérnqvist). 

If sample sizes were allowed to increase, we could 
anticipate that the variances of both the US and UK would 
decrease, but the UK variance would remain lower. The bias 
of the US estimator for the superlative target would be 
unaffected by increased sample size, so that the relative 
mean square error of the UK approach would be increase- 
ingly lower. 

In practice, of course, period 2 quantities are not 
available at the time of sample selection (at period 1), and as 
part of our follow-up study we give some measure of the 
partial degradation that arises from using past quantities: it 
is not severe enough to undo the conclusion of better UK 
performance. Furthermore, the field economist’s judgment 
as to the best seller might be able to invoke data more recent 
than a year earlier. Thus the actual effect might be some- 
where between the lagged and non-lagged versions of 
maxming which we have used. In practice, however, US 
field economists may often sample items within outlets 
based on an estimate of expenditure share that is really a 
smoothed average of base period and recent expenditure 
shares. This may attenuate the bias we have seen in our 
simulations, where only the base period expenditures were 
used for within-store sampling. 
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Table 11 
Biases, Standard Deviations, and Root Mean Square Error (Each Multiplied by 1,000), in Estimating Population All 
Cereals Walsh Index, Chain 8, Based on Three Approaches to Sampling/Estimating Elementary Indexes* 
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(a) Bias 

95-96 °96—’97 ’97—’98 ’98—"99 °99—°00 
dutot/maxming 29 15 —13 33 Z 
dutot/maxming, prior q’s = 46 32 82 36 
geomean/ppswr 78 62 66 82 66 

(b) Standard Deviation 

°95—°96 96-97 °97—’98 98-99 °99—°00 
dutot/maxming 16 13 11 14 12 
dutot/maxming, prior q’s — 14 12 15 14 
geomean/ppswr Ze 18 uty) 18 20 

(c) Root Mean Square Error 

°95—°96 96-797 °97—’98 98-99 °99-—’00 
dutot/maxming 33 20 17 36 12 
dutot/maxming, prior q’s - 48 34 83 39 
geomean/ppswr 80 65 68 84 68 


* At ELI/Representative Item level. To get overall index estimates, the elemenentary index estimates were aggregated 
using known population expenditures. 


"95 — 96, 


pps 


maxming 


95 — 96, 


Table 12 
Ratios of UK RMSE to US RMSE, Chain 8, Walsh Targets: 
maxming Using Lagged q’s & dutot Versus ppswr(Expenditure) & geomean 


Description °96-"97 °97—"98 °98—"99 99-00 
All 0.748 0.498 0.993 0.567 
Classes/Major Groups 
1—Hot 1.539 0.495 1.280 0.765 
2—Sugary 0.563 0.676 0.941 0.797 
3—Fruity 0.409 0.323 0.463 0.852 
4—Plain 0.915 0.560 1.164 0.359 
Item Strata/Sections 
Hot—11 0.748 0.607 0.660 0.657 
Hot—12 1.695 0.599 1359 0.843 
Sugary—21 0.757 0.593 1.136 0.924 
Sugary—22 0.370 0.776 0.751 0.671 
Sugary—23 0.479 0.785 0.796 0.508 
Fruity—31 0.570 0.443 0.678 1.008 
Fruity—32 0.526 0.350 0.277 0.674 
Plain—41 1.167 0.509 1.395 0.397 
Plain—42 0.623 0.411 0.918 0.624 
Plain—43 0.919 Tory 0.668 0.560 
Table 13 
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It is generally accepted that the non-randomization 
approaches are intrinsically cheaper. For example, there are 
typically fewer outlets to visit, and price collection within 
outlets is less labor intensive. Thus, for a given budget we 
can expect the UK approach to be more efficient, compared 
to US probability sampling, than the present study suggests. 

It would be salutary to expand this study to scanner data 
for products other than cereals. In particular, items with 
more volatile price movements would be of great interest. 
To some extent, the good behavior of maxming/dutot may 
be related to the surprising closeness of the population dutot 
to the superlatives (as seen in Table 1). How typical is such 
closeness, and, if it is absent, will the good sampling 
behavior persist? 

One final caveat. It may be a good idea in practice to 
inject a dose of randomness at some stage or stages of the 
sampling process, and in particular be a bit cautious about 
centralized sampling — not for statistical reasons, but to 
guarantee fairness and the appearance of fairness (Reinsdorf 
and Triplett 2005, Section I; Royall 1976). 
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Targets — Population Indexes 
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Appendix B 
An Example Illustrating the Importance 
of Lowest Level Aggregation 


We here present a simple example to illustrate the 
importance of the method used for constructing the 
elementary indexes. We compare population Walsh indexes 
to indexes resulting from aggregating elementary Walsh 
indexes according to a Laspeyres formula instead. The 
reason for focusing on the Walsh is given in Appendix C. 
The “pure” Walsh index is 

g y a. Pp y+l 
W=— pase ieieds 
> Va? a?" p aM 


I 


where the W,’’"' are the h® elementary Walsh indexes 
and 


SIC pty 


~ ieh 


‘ leer 


. = 
are proper Walsh aggegration weights. To this we compare 
a Laspeyres aggregation of elementary Walsh indexes 
(“ersatz Walsh”), Lj,” a Se Sip y+! where the s, 
are standard base period weights. 

The results are given in Table 9. We do see a perceptible 
difference between the actual population Walsh and the 
Laspeyres aggregate of elementary Walsh indexes: the latter 
tends to run slightly higher. However, these differences are 
on a par with the differences between them and the Fisher. 
They are minor compared to the gap between the geomean 
or Laspeyres indexes and the superlatives. This sort of result 
verifies that sound procedure at the lowest level is a key part 
of index construction. 


Appendix C 
The maxming/dutot Combination 


Why does the maxming/dutot combination work so well, 
seeming to lead to unbiasedness for the superlative indexes? 

A referee notes that maxming sampling bears a strong 
resemblance to sampling pps with size variable ./q; q}""; 
for ppswor(./qg’q?”), the dutot is approximately unbiased 
for a Walsh target index, and so, indirectly, for any other 
superlative index. 

Indeed, for the expectation of the numerator of the dutot, 
under this probability sampling scheme, we have 
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where £.() signifies expectation with respect to the sample 
design and J, is a random indicator taking the values 1 or 0, 
as i’ is in the sample or not. We get a similar expression for 
the denominator. The ratio of these two expected values is 
the Walsh. Therefore, apart from the usual (mild) ratio bias, 
which can be shown to be typically positive, the dutot does 
indeed target the Walsh, under this pps scheme. 

We need to ask: do the two modes of sampling actually 
tend to have a sizeable overlap in what items get picked? 
For each run, for each psu /, ELI c, three items were selected 
either by maxming or by ppswor (./q’q?”) of items within 
Ic. Table 13 gives the percentage of times (over 500 runs) 
different items make it into the sample, for some arbitrarily 
selected representative cases. We conclude, not entirely 
without surprise, that: (a) pps sampling leads to a wider 
spread of items selected, (b) the items selected by maxming 
are a subset of those from pps, (c) there is a certain amount 
of correlation of “dominant items’, that is, of those items 
that tend most to be selected by either method. In short, 
maxming and pps(./q? q’*') appear to be related, but 
loosely. 

To get further insight into the relationship between the 
two sampling methods, we calculated bias and mean square 
error estimates, with respect to the Walsh population index, 
for the dutot index for each ELI, both for maxming and 
PPS(./4, 4,41) sampling. The bias and MSE estimates were 
based on 500 runs for each sampling method. Summary 
statistics were calculated across ELI’s for each pair of years 
and each psu. Table 14 gives the percentage of ELI’s for 
which the dutot elementary indexes are positively biased for 
each mode of sampling. As anticipated, pps sampling tends 
to result in positive bias; we find that maxming is equally 
biased positive and negative. 


Table 14 
Percentage of ELI’s for Which the dutot 
has Positive Bias for a Walsh Target, 
for Two Sampling Schemes 


PPS(/4yFy41 ) 


psu 2 psu 3 psu 4 psu 2 psu 3 psu 4 


"95— 96 75,0 86.2: 75.9 64.3611 61.1 
"96-97 = 60.7 72.4 65.5 53.6 65.5 51.8 
907-98 = 65.5 75.9 78.6 41.4 27.6 42.9 
"98-99 72.4 75.9 70.4 48.3 75.9 40.8 
99-00 = 89.7 72.4 75.9 48.3 20.7 44.9 


maxming 
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Table 15 (a) gives the percent of ELI’s in which the 
absolute bias from using maxming is bigger than that from 


PPS(J9y 4,11) In this regard, pps sampling is better. 
However, Table 15 (b) gives the percentage of ELI’s in 
which maxming yielded a larger mean square error, and here 
maxming does better in all but two time periods/psu’s. We 
regard the mean square error criterion as the more decisive, 
especially given the bi-directionality of maxming’s biases. 


Table 15 
Percentage of ELI’s for Which the dutot’s Bias and 
Mean Square Error for a Walsh Target is Less for 
Probability Proportional to Size 
(Size Variable = ./q,,q,,; ) than 
for maxming Sampling 


(a) Bias of pps less (b) MSE of pps less 
psu2 psu3 psu4 psu2 psu3 psud 


'O5 96 Papo oa Lb 80:2 32 len os.0 4d 
OSE OT S92 8966 OO) 135.0 CS 7 9RE2 6 
907-98 = 89.7 86.2 100.0 41.4 24.1 64.3 
"98-799 89.7 82.8 92.6 41.4 37.9. 40.7 
99 =""00 89.7 96:6 41.4 345 (31.0 37.9 


We conclude that the good effects of maxming sampling 
combined with the dutot estimator are not explainable in 
terms of approximate mimicry of pps sampling. They 
behave differently; and overall maxming seems to be 
somewhat better than pps (./4, 4y41): 

We can see no alternative to explain why the dutot 
sample index should target the Walsh population index 
when the consistently largest sellers are sampled than that of 
this “brute force” mechanism: to the extent that the Walsh 
can be represented by a small sample of items, it is best 
represented by those with the consistently largest quantities, 
and these items are the ones the maxming sampling scheme 
supplies. 
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Abstract 


Researchers and policy makers often use data from nationally representative probability sample surveys. The number of 
topics covered by such surveys, and hence the amount of interviewing time involved, have typically increased over the 
years, resulting in increased costs and respondent burden. A potential solution to this problem is to carefully form subsets of 
the items in a survey and administer one such subset to each respondent. Designs of this type are called “split-questionnaire” 
designs or “matrix sampling” designs. The administration of only a subset of the survey items to each respondent in a matrix 
sampling design creates what can be considered missing data. Multiple imputation (Rubin 1987), a general-purpose 
approach developed for handling data with missing values, is appealing for the analysis of data from a matrix sample, 
because once the multiple imputations are created, data analysts can apply standard methods for analyzing complete data 
from a sample survey. This paper develops and evaluates a method for creating matrix sampling forms, each form 
containing a subset of items to be administered to randomly selected respondents. The method can be applied in complex 
settings, including situations in which skip patterns are present. Forms are created in such a way that each form includes 
items that are predictive of the excluded items, so that subsequent analyses based on multiple imputation can recover some 
of the information about the excluded items that would have been collected had there been no matrix sampling. The matrix 
sampling and multiple-imputation methods are evaluated using data from the National Health and Nutrition Examination 
Survey, one of many nationally representative probability sample surveys conducted by the National Center for Health 
Statistics, Centers for Disease Control and Prevention. The study demonstrates the feasibility of the approach applied to a 
major national health survey with complex structure, and it provides practical advice about appropriate items to include in 


matrix sampling designs in future surveys. 


Key Words: Missing data; Multiple imputation; Respondent burden; Split questionnaire; Sample survey. 


1. Introduction 


Data from sample surveys are used by researchers and 
policy makers in many fields. These surveys often involve 
nationally representative probability samples and extensive 
data collection based on questionnaires, and they must 
balance the competing goals of reasonable length and 
completeness in providing relevant information. The 
number of topics covered by such surveys, and correspond- 
dingly the amount of interviewing time involved, have 
typically increased over the years. The resultant increased 
respondent burden may be among the factors contributing to 
the declining response rates that have occurred. Such 
declining rates can result in reduced precision of survey 
estimates. They can also result in increased bias, if 
systematic differences between the nonrespondents and 
respondents are not accounted for in analyses of the 
incomplete data. Moreover, the expansion of topics covered, 
along with efforts to maintain high response rates, have 
increased the costs of conducting surveys. 


One potential solution to the problem of providing the 
information that is needed while limiting respondent burden 
is to carefully form subsets of the items in a survey and 
administer one such subset to each respondent. Different 
subsets of questions (items) are administered to different 
subsets of respondents, so that each item is administered to 
at least some of the respondents. Questionnaire designs of 
this type are called “split-questionnaire” designs or “matrix 
sampling” designs, the latter name reflecting the idea that 
respondents (rows) and items (columns) are both “sampled” 
from a conceptual complete population data matrix. In many 
matrix sampling designs, some items (herein called “core” 
items) are administered to all respondents, whereas other 
items (herein called “split” items) are only administered to a 
subset of respondents. Typically, the items chosen to be core 
items either are especially important or are predictive of 
many of the split items. 

The administration of only a subset of the survey items to 
each respondent in a matrix sampling design creates what 
can be considered missing data, with the missingness being 
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mkatzoff@cde.gov; Clifford L. Johnson, Division of Health and Nutrition Examination Surveys, National Center for Health Statistics, Centers for 
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at random or even completely at random (Rubin 1976), 
since the missing data are the result of a known probability 
mechanism based possibly on design variables. Multiple 
imputation (Rubin 1987), a general-purpose approach devel- 
oped for handling data with missing values, is appealing for 
the analysis of data from a matrix sample, because once the 
multiple imputations are created, data analysts can apply 
standard sample survey methods to the analysis of the 
completed data. Moreover, if the matrix sample has been 
designed in such a way that the items that are administered 
to each respondent are predictive of the items that are not 
administered, then the multiple-imputation approach can 
utilize the included items to recover information about the 
excluded items. We focus on multiple imputation because it 
is well-suited for this situation: 1) the burden of applying 
complex multivariate methods can be performed once by 
the survey organization most familiar with the design; 2) it 
can be implemented with existing software; and 3) it does 
not require novel methods for each of the numerous 
estimands targeted in most studies. However, alternative 
estimation methods to multiple imputation, both model- 
based and design-based, can be developed and applied to 
data from matrix designs. 

The matrix sampling approach has been applied or 
explored in various settings, such as educational assessment 
(Sirotnik and Wellington 1977; Beaton and Zwick 1992; 
Zeger and Thomas 1997), health research (Wacholder, 
Carroll, Pee and Gail 1994; Raghunathan and Grizzle 1995; 
Houseman and Milton 2006), the US Census (Navarro and 
Griffin 1993), and business (Shoemaker 1973). Moreover, a 
type of matrix sampling was also used in the National 
Health Interview Survey of the National Center for Health 
Statistics (NCHS), Centers for Disease Control and Pre- 
vention prior to 1997. In that survey, chronic conditions 
were divided into six lists, and information about the 
conditions on each list was obtained from about one-sixth of 
the respondents (Schenker, Gentleman, Rose, Hing and 
Shimizu 2002). In the context of data collection for a 
general purpose national health survey, however, an 
approach to creating matrix sample designs that exploits the 
inherent associations among the items has not been studied. 

This paper develops and evaluates a method for creating 
matrix sampling forms, each form containing a subset of 
items to be administered to randomly selected respondents. 
The method can be applied in complex settings, including 
situations in which skip patterns are present. Forms are 
created in such a way that each form includes items that are 
predictive of the excluded items, so that subsequent analyses 
based on multiple imputation can recover information about 
the excluded items that would have been collected had there 
been no matrix sampling. The method assumes that a 
training sample is available. The training sample may be 
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from a previous administration of a complete survey or from 
a pilot sample collected to support survey design. The 
matrix sampling method is evaluated in a study using data 
from the National Health and Nutrition Examination Survey 
(NHANES), one of many nationally representative surveys 
conducted by NCHS  (http://www.cdc.gov/nchs/nhanes. 
htm). The NHANES, a cross-sectional survey which has 
been repeated several times during different time periods, 
obtains a large amount of data from respondents via a 
household questionnaire, a linked mobile-site medical ex- 
amination, and laboratory analysis of biological specimens. 
It is of interest to examine the feasibility of matrix sampling 
designs for surveys such as the NHANES, which has 
intricate structural dependencies among its items reflected in 
its numerous skip patterns, along with its multiple survey 
components. For purposes of realism, the form-design 
method is applied using pilot data from the Second 
NHANES (NHANES II), and then the resulting design, 
together with multiple-imputation methods, are evaluated in 
a simulation study based on NHANES III data. Section 2 
describes the method for designing matrix sampling forms. 
In Section 3, the design and results of the study based on the 
NHANES are described. A concluding discussion is given 
in Section 4. 


2. Designing Matrix Sampling Forms 


This section develops a method for creating matrix 
sampling forms, each form containing a subset of items to 
be administered to selected respondents. 

In designing a matrix sample, it is necessary to decide 
which items will be core items to be included on all forms, 
and which items will be split items to be included on only 
some forms. Typically, the core items are selected based on 
substantive judgment as well as other considerations about 
the relative importance of items. Key items, for which 
precision of certain estimators is to be maximized, should be 
designated as core items, whereas less important items can 
be designated as split items. In addition, it is useful to select 
core items that are predictive of many of the split items, so 
that information about split items that are excluded from a 
form can be recovered from the core items in conjunction 
with the split items that are included in the form. Finally, the 
cost and respondent burden associated with an item are a 
consideration, since it can be beneficial to designate expen- 
sive and/or burdensome items as split items. The emphasis 
in this development is on how to allocate the split items to 
forms once the core items have been chosen, so it is 
assumed here that the core items have already been selected. 
However, it will be seen that the method for allocating split 
items uses a measure that also accounts for the usefulness of 
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the core items for predicting the split items. The potential to 
predict split items is estimated from a training sample. 

It is also necessary to select a format for organizing the 
split items. To ensure that every pair of split items appears 
together on some form, so that direct estimation of all two- 
way associations between variables is possible, the split 
items are divided into blocks, and matrix sampling forms 
are created by putting two or more blocks of split items 
together (Raghunathan and Grizzle 1995). The size and 
number of blocks determine the length and number of 
forms. For example, in the study involving the NHANES to 
be discussed in Section 3, the split items are divided into 
four blocks, and each form contains two blocks (along with 
the core items), so there are a total of six (4 choose 2) forms. 
In the method developed here, the blocks are of ap- 
proximately equal size, and each split item is assigned to 
only one block. Using blocks of the same length yields 
similar reduced burden for all study participants. It also 
yields similar precision for items of the same type. These 
features are not requirements for all matrix sampling 
designs, however. If additional precision of estimation were 
desired for an item, it could be included on more than one 
form, or it could be designated as a core item to be included 
on all forms. 

A good matrix sampling design allocates split items to 
blocks in such a way that for each split item excluded from 
a block, there are split items included in the block that, 
together with the core items, are predictive of the excluded 
item; this facilitates the recovery of information about the 
excluded item during analyses of the data. The discussion 
below develops a method aimed at achieving this goal. The 
development is in two parts. First, in Section 2.1, an index is 
formulated for ranking how well each split item is predicted 
by every other split item, with predictive utility assessed as 
relative gain in precision conditional on the core items being 
included. Methods are also given for estimating the values 
of the index from a training sample. Second, in Section 2.2, 
an algorithm for assigning split items to blocks based on the 
index of predictive value is described. 


2.1 An Index of Predictive Value 


2.1.1. Preliminary Notation for Matrix Sampling 
Designs 


Pet. Y..denote..a split item, to..be./predicted,, X = 
(X,, ..., X.) denote the core items, and Z denote a split 
item used to predict Y. 

As mentioned above, a matrix sampling design creates 
what can be considered missing data. Thus, the subjects in a 
potential matrix sampling design can be ordered so that the 
N4, Subjects with observed values of Y are listed first, the 
f—valucs beme.denoted by _Y,,..«,)7,,.s.and the. n,,. 


n 


subjects with missing Y — values follow, the Y —values 
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ie i 


> 
Mot 


being denoted by Y, ,;, -. where 7,,, = 7 
is the total number of observations. 

The expectation and variance of Y in the population 
targeted for matrix sampling are denoted by E(Y) and 
V(Y). 


obs a I mis 


2.1.2 Simplifying Assumptions 


Several assumptions are made to simplify the calculation 
of the index. The assumptions are used when computing the 
index, but not in subsequent data analyses. Each assumption 
could be weakened or eliminated if additional research 
indicates that it results in substantial degradation to the 
assessment of potential matrix sampling designs. 


1. Each split predictor Z is considered separately 
when added to the core items X. If there are 
several items with high mutual correlation, the 
assignment algorithm attempts to put the items in 
different blocks as required for an effective matrix 
design. A multivariate approach based on partial 
correlations accounting for other split items would 
be anticipated to yield similar properties, and would 
require much more computation. 

2. Each split predictor Z is assumed to be fully 
observed, when in practice, it will not always be 
available to predict Y because Z is itself a split 
item. Also, the occurrence of unplanned missing 
data (ie., missing data not created by matrix 
sampling) is not considered. Although these as- 
sumptions may overstate the usefulness of Z for 
improving estimates of E(Y), such overstatement 
may be ameliorated via multivariate methods that 
utilize several variables Z. Moreover, each Z will 
be administered the same number of times, so any 
systematic bias in predictive value should be 
approximately the same for each split item; the 
primary use of the index is to order items, which is 
not changed by a common bias. 

3. For derivation of the index values, simple random 
sampling is assumed for both the respondents in the 
matrix sample and for the training sample. Again, 
consistent overestimation of precision is not antic- 
ipated to substantially diminish the performance of 
the index. 

4. Itis assumed that matrix sampling produces missing 
data that are missing completely at random. This 
assumption is satisfied for all of the matrix designs 
considered. 

5. For purposes of deriving approximations below, it is 
assumed that n,, 1S large and that the ratio 
Nong / Mor 1S fixed as n,, increases. This approxi- 
mation should be adequate for most estimands in 
national surveys. 
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2.1.3 Estimation Based on Multiple Imputation 


The index of predictive value to be developed is based on 
the goal of estimating E(Y) via multiple imputation applied 
to the matrix sample. A multiple-imputation-based esti- 
mator, y, of E(Y) is approximated, under the assumption 
of an infinite number of imputations, as 


In this expression: M is the number of imputations; and y, 
is the mean from the j" completed data set with imputed 
values Y, ;, 1=My, + 1, ..., Mor, and observed values 
Y,,=Y¥, i=, ..., m4, (which do not change across 
completed data sets), that is, 


Not n. 


01 Nobs tot 
A ail 
Yj = Not Se iJ yy Xs} 
i=] 


i=] 1=Ngp.t 1 


— _ 7 -l 
yj = Neot 


An estimator of the variance of y when the imputations are 
created using X and Z, based on the common variance 
formula in Rubin (1987, Section 3.1), is 


Vu = Wests BL Ving! (1) 


where the first term is an estimate of the variance that would 
be obtained with complete data, and the second term is an 
estimate of the variance between imputed data sets. With 
large samples, so that the variance of Y can be treated as 


known, Voomp = V(¥)/Mo, and 
M — 
ee ey ey) (2) 


j=l 


It is assumed throughout that the imputation model is 
compatible with the complete-data model, so the variance 
estimator in (2) is consistent (Rubin 1987, Section 3.6; 
Meng 1994). 


2.1.4 Defining the Index 


When matrix samples are collected, simple but 
potentially inefficient estimators of univariate summaries of 
a split item, Y, can be obtained from the observed data 
without any imputation (that is, using just the observed 
values of Y), because the subjects the missing Y — values 
are missing completely at random; the variance of the no- 
imputation estimator of E(Y) is denoted by Vy = 
VY.) (top. 

The proposed index is the proportion of the difference 
between Vy; and V,,,,, that is recovered by the multiple- 
imputation estimator, which incorporates the information 
containedin X and Z: 


Vie dus 
1(¥|X, Z) = Ma Yu (3) 
Vu a Vices 
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The index /(Y |X, Z) takes the value 1 when X and Z 
perfectly predict the omitted values of Y (so that 
Var = Veomp)> and it takes the value 0 when X and Z do 
not predict the omitted values of Y at all, so that the 
multiple-imputation estimator is not an improvement over 
the no-imputation estimator (7.e., Vy; = Vyz)- 

The index can be used to assess the potential contribution 
of each split item Z to the estimation of the mean of every 
other split item Y. A desirable matrix sampling design 
ensures that for each split item Y that is excluded from a 
block, there are other split items Z included in the block 
with high index values for predicting Y, so that information 
about Y can be recovered during analyses of data from the 
matrix sample. 


Note: 
Te ethe* warianecs 49 VaeeVicnss ald evens eeale 
proportional to n,|, so I(Y |X, Z) is independent 


Oni 

2. Ifthe core items X are highly predictive of Y, the 
index will not differentiate much between the 
remaining split items Z; but in this situation, the 
selection of appropriate Z for predicting Y is less 
important, since Y is already predicted well by X. 


2.1.5 Approximating vie 


To facilitate the computation of the index /(Y | X, Z), it 
is useful to approximate the variance V,,,.. The approxi- 
mation developed here refers to a specific matrix sampling 
design, presuming that one has been chosen. 

Assume that the distribution of Y given (X, Z) follows 
a generalized linear model with a link function wu that 
depends on unknown parameters 8, 


E(Y|X, Z) = ((X", Z)B), 


where the link function is equal to the identity for 
continuous Y, u(Y)=Y, and the logistic function for binary 
Y, u(Y) = logit '(Y). For continuous Y, a constant 
residual variance, o*, is also assumed. Although they are 
not developed here, extensions of these models and methods 
can be developed for categorical and ordered categorical 
variables. The individual categories can be represented by 
binary variables, or summaries can be formed when there 
are numerous categories. 

Schafer and Schenker (2000) derived an approximation 
to the variance between imputed data sets, that is, Mae 
when the estimate computed from each completed data set 
is a smooth function g of the means of the variables 
involved. (In the current development, g is the identity.) 
Their approximation, which is based on first-order Taylor 
series expansions of g and wu and large-sample results 
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from the theory of sample surveys (e.g., Wolter 1985, 
Chapter 6), will be used here. 

Maximum likelihood (or quasi-likelihood, McCullagh 
and Nelder 1989) estimation of B based on the 7,,, sub- 
jects with observed values of Y yields an estimator, 8, 
with variance-covariance matrix V,,.(B) (recall eee 
en 4 of Section 2.1.2). Set 1... (B= = n Polis 


i=Nyp, +1 


(EXE PZ; Bp), and denote its derivative with respec to the 
th 


j" component of B evaluated at B by ne 8), pa 
1, ..., (c +1). The derivative has the form 


pe J) 2; ie > Xx; t(B, X;, Z;) j=l, seey C 


1=Nops +1 


and 


Di Ziel (Be Xia 
1=Ngp5 +1 
where f(B, X,, Z,) = w(X/, Z;)B)[1 - 1X7, Z,) B)] 
when Y is binary. When Y is continuous, /(B, X,, 
Z,)=1, which implies that the derivatives [),,, ,B) are 
equal to the means of the core items X and the split item 
Zi. 

Now let pW’... (B) denote the vector of derivatives and 
P.,, denote the proportion of subjects with missing Y. 
Applying equation (10) of Schafer and Schenker (2000), 
with their function g equal to the identity, and their general 
parameter 6 equal to B, yields 


~ =| 
Minis, c+1 (Me Ti Nevis 


: 
na Lah u((X/, Z,) B) 

V ~ P2 ae i=Ngp, ani ; 4 

fou [I — n((X7, Z,) B)] - 
+ (Biis(B))” Vers (B) Hinis (B) 


when Y is binary, and 


V, ilo ony. ee(B) Wee, (Baldor (6) 


imp ~ vail 


(His (B))’ V, 


when Y is continuous. 


2.1.6 Estimating the Index of Predictive Value from 
a Training Sample 


Because the planned missing data in our matrix sampling 
designs are assumed to be missing completely at random, 
sample moments and other parameter estimates from a 
training sample can be used to estimate the corresponding 
moments and parameters in both the subsamples with 
observed and missing values of Y, under the assumption 
that the training sample is drawn from the same target 
population. The moments and parameters include: eS ig 
the residual variance o*, which can be estimated by 6%, 
the estimated residual variance from the regression fitted to 
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the training sample; the regression coefficients, with 
estimates 8, from the training sample; and the variance- 
covariance matrix of the regression coefficients, which can 
be approximated by rescaling the estimate V, V..B,.) from the 
training sample to obtain V,,.(B) ~ thie PALIVAB.Y, 
where n,, 1s the size of the training sample. The derivatives 
fe (B) and the function involving 1 in (4) are also in the 
form of subsample means, and thus can be estimated by the 
corresponding means in the training sample. Denoting the 
derivatives in the training sample by [1'.(B,,), and sub- 
stituting the training sample estimators into (4) and (5), 
yields 


ne > w((X!, Z,) By) 
=A 


[Il - u((X7, Z,) B,)] (6) 


ae a (Hi, (B,))" Nes (B..) Hi, (B,,) 


obs 
for binary variables, and 


V. + (Ge Anes 


imp — Eis 


abou n es (7) 


for continuous variables, with the latter expression follow- 
ing from the fact that (j/, (B,.))” V..(Bi) bis (B.,.) reduces to 
the simple form 6: / n,,. 


2.2 Assigning Split Items to Blocks 
2.2.1 Design Criteria 


Matrix sampling forms are created by allocating split 
items to different blocks, as described at the beginning of 
Section 2. Four design goals guide the assignment of items: 
1) assign each split item to a single block; 2) assign an 
approximately equal number of items to each block; 3) 
assign logically linked items to the same block; and 4) 
assign one or more items to each block that predict the items 
omitted from the block. Denote the number of blocks by 
Ayiock (Mock = 4 tn the NHANES simulation study). 

A quantitative criterion for the fourth goal is specified 
separately for each split item Y by finding the (n,, —1) 
other split items Z with the highest predictive index values 
I(Y |X, Z), for the potential allocation of one of them to 
the (”,,., —1) blocks not containing Y. The items Z 
exclude those items linked to Y, which must appear with 
Y ina block. The (7, —1) values of /(Y | X, Z) for the 
items Z provide an upper limit on the predictive indices 
that could be achieved for Y. Because these optimal index 
values are determined separately for each split item Y, they 
may not be achievable for all items Y simultaneously. 

To evaluate a given matrix sampling design, the highest 
index value /(Y |X, Z) actually achieved for each of the 


(Nyjock ~1) blocks not containing a split item Y is 
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determined. The average of the (”,,.,.—1) differences 
between these indices and the corresponding optimal 
predictive indices for Y is computed. These average 
differences are then averaged across all of the split items Y 
to yield an overall measure for the design. 


2.2.2 An Assignment Algorithm 


The criteria in Section 2.2.1 require maximization over a 
set of integer inputs (block assignments) to a function 
subject to a set of linear constraints imposed by the need to 
create approximately equal-length blocks with some items 
potentially linked together. Although integer programming 
methods could be applied to this maximization, the follow- 
ing algorithm is much simpler, and it achieved nearly 
optimal results for the NHANES application, as demon- 
strated in Section 3.1. 


Step 1. Randomly order the split items. The assignment of 
items to blocks proceeds sequentially, via repetition of steps 
2 and 3 below, until all of the items have been assigned. 


Step 2. Assign the next (or first) unassigned item, say Y, 
to the block with the fewest items. If multiple blocks are 
tied, assign Y“°’ to the block with the lowest maximum pre- 
dictive index 1(Y°° | X,Z) for Y. Ifa tie still remains, 
assign Y°” to any of the eligible blocks. If there are items 
linked to Y‘°’, also assign them to the selected block. 


Step 3. For each item assigned in Step 2 (Y or its linked 
items), find the remaining unassigned item, say Y (most 
predictive of it. Assign Y“” (and any items linked to Y“”) 
to a block other than the block selected in step 2, by 
following the same procedure that was used for Y in 
step 2. 

Experience with the NHANES data suggests moderate 
sensitivity of the algorithm to the initial ordering of the 
items (in step 1). To reduce the dependence, 1,000 designs 
were generated with randomly selected orderings, and the 
one yielding the best overall measure of predictive value (as 
defined at the end of Section 2.2.1) was selected. 


3. A Study Using Data from the NHANES 


To assess the feasibility of a matrix sampling design for a 
survey like the NHANES, an evaluation study was 
conducted. First, NHANES II (i.e., the second NHANES) 
was used to create a matrix sampling design via the method 
described in Section 2. This simulates the realistic situation 
in which data from a previous survey are used in designing 
the questionnaire for a new survey. The design so developed 
was then applied to several simulated samples created from 
NHANES II data. The subjects in NHANES III with 
complete data on a selected set of variables were treated as a 
large finite population. One hundred samples were drawn 
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from the NHANES II finite population using a stratified 
two-stage sample design with unequal probabilities of 
selection. The complete data are available for each 
simulated sample, providing a “gold standard.” The matrix 
sampling design was then imposed on each sample, and the 
missing values due to matrix sampling were multiply 
imputed. Several analyses were conducted using the matrix 
samples without imputation, the multiply imputed matrix 
samples, and the samples of complete data (i.e., the gold 
standard). Results summarized across the simulated samples 
yield estimates of the repeated sampling properties of the 
different methods. 

The matrix sampling design created using NHANES II 
data is summarized in Section 3.1. The design of the 
simulation study using NHANES III data is described in 
Section 3.2. Results of the study are presented in Section 
3.3. Some limitations of the study that are not discussed in 
Sections 3.1 —3.3 are covered in Section 3.4. 


3.1 A Matrix Sampling Design Based on Training 
Data from NHANES II 


Given the time that would have been required to extract 
and analyze all of the NHANES III variables, only a subset 
were included in the study to keep it manageable, although 
the software utilized in the study could be applied with 
many more variables. The variables in the study include 
items representing many of the topics included in the survey 
and were selected in consultation with substantive experts. 
The data types include binary and continuous variables 
representing survey questions and laboratory measurements. 
One pair of items forming a skip pattern was included: 
“Have you smoked 100+ cigarettes?” followed by “Do you 
smoke now?” The algorithm for assigning split items to 
blocks, described in Section 2.2, forced these items to be in 
the same block. 

Table 1 gives brief descriptions of the variables included. 
Variables that appeared in NHANES III but not in 
NHANES II (again, a realistic situation) have asterisks next 
to their names. 

As mentioned earlier, the matrix sampling design was 
constructed with four blocks. Each block contained all of 
the core items. In addition, the split items that appeared in 
NHANES II were allocated to the blocks by applying the 
methods developed in Section 2 to data from NHANES IL. 
(In estimating the necessary indices, missing values in the 
NHANES II data were handled by analyzing only the 
complete cases.) The split items that did not appear in 
NHANES II were randomly divided and assigned to the 
blocks to keep the block lengths approximately equal. The 
“Type” column of Table 1 identifies the core and split 
variables and indicates the block assignments for the split 
variables. 
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For each split item that appeared in NHANES II, Table 2 
displays the following: the block to which the item was 
assigned (“Block’’); the three highest predictive indices for 
other split items as predictors of the item in question 
(“Optimal”); and the highest index values actually achieved 
by the selected design in the three blocks not containing the 
item in question (“Achieved”). The index values are sorted 
from low to high for each item in question, so the columns 
in the table containing index values do not correspond to 
specific items or blocks. Table 2 shows that the selected 
design is nearly optimal for the criteria of Section 2.2.1. For 
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example, the average difference between the optimal 
predictive indices and the corresponding indices actually 
achieved is only 0.002. 

The column of Table 2 labeled “Low” under “Achieved” 
provides lower bounds on the anticipated improvement in 
estimators of univariate means for the split items. Nineteen 
of the twenty-one predictive indices in this column are less 
than 0.20, suggesting relatively low efficiency for multiple- 
imputation estimators in this matrix sampling design. For 
more discussion of this issue, see Sections 3.3 and 4. 


Table 1 


Variables from NHANES III that were Included in the Evaluation. 
Items Marked with Asterisks did not Appear in NHANES II 


Variable Name Description of the Variable Type 
BMPBMI Body Mass Index Core 
GFIP* Serum Cholesterol (MG/DL) Core 
DMARETHN Race-Ethnicity Core 
DMPCREGN Census Region, Weighting(Texas in South) Core 
DMPMETRO Rural/Urban Code Based on Usda Code Core 
GHP Glycated Hemoglobin: (%) Core 
HAB1 Is Health in General Excellent, ..., Poor Core 
HAB2* Go to Particular Place for Health Care Core 
HABS5* Past 12 Months, # Times Saw Doctor Core 
HACIC Doctor Told: Congestive Heart Failure Core 
HAC1L* Doctor Ever Told you Had: Lupus Core 
HACIM Doctor Ever Told you Had: Gout Core 
HAD 1 Ever Been Told you Have Sugar/Diabetes Core 
HAD10 Are you Now Taking Diabetes Pills Core 
HAE3 Told 2+ Times you Had Hypertension/HBP Core 
HAF10 Doctor Ever Told you Had a Heart Attack Core 
HAF26 Severe Dizziness for More Than 5 Minutes Core 
HAL] Cough Most Days, 3+ Consecutive mo in YR Core 
HAL6 Had Wheezing, Whistle in Chest Past 12 MO Core 
HALI4E Symptoms Brought on by: Pollen Core 
HAZMNKI1R Average K1 BP from Household and MEC Core 
HAZMNK5R Average KS BP from Household and MEC Core 
HFA12 Marital Status Core 
HFA8R Highest Grade or YR of School Completed Core 
HSAGEIR Age at Interview (Screener) — Qty Core 
HSSEX Sex Core 
LEP Serum Insulin (UU/ML) Core 
GIP Plasma Glucose (MG/DL) Split — 1 
HACIJ Doctor Ever Told you Had: Goiter Split — 1 
HACIN* Doctor Ever Told you Had: Skin Cancer Split — 1 
HAC1O Doctor Ever Told you Had: Other Cancer Split - 1 
HAF14* Get Pain in Either Leg While Walking Split — 1 
HALIIA Stuffy, Itchy, or Runny Nose, Past 12 MO Split — 1 
BMPWHR* Waist to Hip Ratio Split — 2 
HACIE Doctor Ever Told you Had: Asthma Split — 2 
HACIK Doctor Ever Told you Had:Thyroid Disease Split — 2 
HAF24 Numbness etc, 1 Side Face/Body for > 5 Min Split —2 
HALIIB Watery, Itchy Eyes in Past 12 Months Split —2 
HAL19A* In Past 12 Months Had: Cold or Flu Split — 2 
HALI9C* In Past 12 Months Had: Pneumonia Split — 2 
HAT28 Active Compared with Men/Women your Age Split — 2 
PDP Lead (UG/DL) Split — 2 
SPPFVC* FVC, Largest Value (ML) Split — 2 
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Table 1 (Continued) 
Variables from NHANES III that were Included in the Evaluation. 
Items Marked with Asterisks did not Appear in NHANES II 


Variable Name Description of the Variable Type 

FEP Serum Iron (UG/DL) Split — 3 

HAF1 Ever Had Any Pain or Discomfort in Chest Split —3 

HAF23 Weak/Paralysis on Face, Arm, Leg For > 5 Min Split —3 

HALI19B In Past 12 MO Had: Sinusitis/Sinus Prob Split — 3 

HARI Have you Smoked 100+ Cigarettes In Life Split — 3 

HAR3 Do you Smoke Cigarettes Now Split — 3 

SPPPEAK* Peak Expiratory Flow Split —3 

BDPTOBMD* Bone Mineral Density Total Region-GM/CM SQ Split —4 

HAB4 Past 12 MOS, # Times Stayed in Hospital Split —4 

HACID Doctor Ever Told you Had: Stroke Split — 4 

HACIF Doctor Ever Told Had: Chronic Bronchitis Split —4 

HACIH Doctor Ever Told you Had: Hay Fever Split —4 

HACII Doctor Ever Told you Had: Cataracts Split — 4 

HAE6* Ever Had Blood Cholesterol Checked Split —4 

HAMI11* Consider Self Over/Under/Right Weight Split —4 

HAE7* Doctor Told Blood Cholesterol Level High Split—4 

Table 2 
Indices of Predictive Value Based on NHANES II Data for the Split Items in the Matrix Sampling Design 
Optimal Achieved 

Item Block Low Medium High Low Medium High 
HAC1J(GOITER) 1 0.04 0.04 ONS 0.04 0.04 0.15 
HAC10(OTHER CANCER) 1 0.05 0.06 0.13 0.05 0.06 0.13 
HAL11A(NASAL SYMPTOMS) 1 On 0.27 0.29 0.17 0.27 0.29 
G1P(PLASMA GLUCOSE) 1 0.26 0.30 0.43 0.26 0.30 0.43 
HAC1E(ASTHMA) 2 0.09 0.10 0.13 0.08 0.09 0.13 
HAC1K(THYROID DISEASE) 2 0.07 0.07 0.15 0.07 0.07 0.15 
HAF24(NUMBNESS) Z 0.12 Ova? 0.12 0.11 0.12 0.12 
HAL11B(WATERY EYES) 2 0.14 0.15 0.25 0.14 0.15 0:25 
HAT28(ACTIVE FOR AGE) 2 0.12 0.13 0.16 0.11 0.13 0.16 
PBP(LEAD (UG/DL)) 2 0.19 0.20 0.21 0.18 0.20 0.21 
HAF 1(PAIN IN CHEST) 3 0.25 0.29 0.29 0.23 0.25 0.29 
HAF23(WEAK/PARALYSIS) 3 0.08 0.12 0:12 0.08 0.12 0.12 
HAL19B(SINUSITIS/SINUS) 3 0.07 0.12 0.21 0.07 0.12 0.21 
HAR1(100+ CIGARETTES) 3 0.13 0.14 0.14 0.13 0.14 0.14 
HAR3(SMOKE NOW) 3 0.10 0.11 0.12 0.10 0.11 O12 
FEP(SERUM IRON) a) 0.05 0.05 0.08 0.05 0.05 0.08 
HAB4(# HOSP STAYS) 4 0.07 0.11 0.19 0.07 0.11 O19 
HAC1D(STROKE) 4 0.19 0.20 0.24 0.18 0.20 0.24 
HAC1F(BRONCHITIS) 4 0.10 0.12 0.12 0.10 0.10 0.12 
HAC1H(HAY FEVER) 4 0.07 0.07 0.09 0.04 0.07 0.09 
HAC1I(CATARACTS) 4 0.08 0.09 0.12 0.08 0.09 0.12 


Note: Optimal predictive indices are determined for each item separately and may not be achievable for all 


items simultaneously. 


3.2 Design of the Simulation Study Based on 
NHANES III Data 


3.2.1 Population and Sample Design 


The matrix sampling design and multiple-imputation 
analysis could be applied to the entire NHANES III sample. 
Although this would be informative, a study based on a 
single data set would not allow the assessment of repeated- 
sampling statistical properties of the methods studied. 
Therefore, the 11,759 subjects from the NHANES III 
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survey who had complete data on the variables listed in 
Table 1 were treated as a finite population, and repeated 
samples were drawn from this population. In selecting sam- 
ples, a complex sample design was used instead of simple 
random sampling to create a more realistic simulation study. 
To achieve this objective, three design variables were added 
to the finite population: (1) simulation stratum; (2) simu- 
lation cluster; and (3) simulation sample weight (here, the 
modifier “simulation” is used to distinguish these quantities 
from the original NHANES III design variables). 
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Simulation strata: The NHANES III public-use 
sample has 49 strata with two clusters per stratum. 
The strategy for the simulation study was to create a 
smaller number of strata with a larger number of 
clusters within the strata, to ensure sufficient 
sample-to-sample variation between the simulated 
samples. The 49 original strata were collapsed into 
20 simulation strata as follows. Each of the 49 
original strata were classified into one of eight 
categories formed from the cross-classification of 
census region (4 levels) and rural/urban status based 
on the United States Department of Agriculture 
code (2 levels). Within each of these eight cate- 
gories, a cluster analysis was performed using the 
stratum-level proportions of non-Whites to select 
the original strata to combine. Combining the orig- 
inal strata created two or three simulation strata 
within each of the eight categories, yielding a total 
of 20 simulation strata. This method of creating 
larger strata also increased the racial heterogeneity 
between the resulting simulation strata, which in- 
creases the importance of weighting in the analyses. 


Simulation clusters: The NHANES III public-use 
sample has 98 clusters, with two clusters in each of 
the original 49 strata. After the 49 original strata 
were collapsed into 20 simulation strata, the original 
clusters were subdivided based on another cluster 
analysis using systolic and diastolic blood pressure 
readings and body mass index (BMI). Subjects with 
similar values were grouped together to create a 
setting with intraclass correlation for these three 
variables within each simulation cluster. The num- 
ber of simulation clusters per simulation stratum 
ranged from 3 to 25, and the number of subjects per 
simulation cluster ranged from 30 to 98. 


Simulation sampling weights: The simulation 
sampling weights were determined by the follow- 
ing two-stage sample design. First, from each 
simulation stratum, two simulation clusters were 
drawn via simple random sampling without 
replacement. Because there were unequal numbers 
of simulation clusters across the 20 simulation 
strata, the simulation sampling weight correspond- 
ding to this stage was w,,=4A,/2,h=1, 2.,...., 
20, where A, is the number of simulation clusters 
in simulation stratum h. 

Second, from each selected simulation cluster, 30 
subjects were drawn at random without replacement 
with varying probabilities of selection. If the cluster 
size was 30, then all subjects were included in the 
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sample. For clusters with more than 30 subjects, the 
first-draw selection probabilities were computed by 
normalizing the reciprocals of the original weights 
from the NHANES III public-use sample to sum to 
1 within each simulation cluster, with the normal- 
ized reciprocal for each subject used as the selection 
probability for that subject. The first-draw selection 
probabilities within simulation clusters ranged from 
0.0003 to 0.2756. 

Let i index sampled subjects within a simulation 
cluster, c denote sampled clusters within a simula- 
tion stratum, and hf denote simulation strata as 
abever f= LEZ, PSO eS 102 thay 22807 200 1F 
the size of cluster c in stratum h was 30, then the 
second-stage simulation weight for subject i in 
cluster c was w,,,, =1. If the size of cluster c in 
stratum fh was greater than 30, then the second- 
stage simulation weight for subject i in cluster c 
WaS W,;, © 7%, Where 7,,, denotes the first-draw 
selection probability for subject i. The final 
simulation sampling weight for each sampled 
subject was w.3=W,, XW, 7=1, 2,::.:, 30;¢= 
DP 2Nh a1 92, e220: 


The design effects for estimating population means 
averaged approximately 2.1 in this simulation study. The 
complex sample design features in the study are informative 
in the sense that ignoring the design features in analyses of 
data may result in biased estimates and underestimation of 
sampling variances. This is due in particular to the use of 
data on race, blood pressure, and BMI in the simulation 
sampling design, and the well-documented connection be- 
tween race/ethnicity and blood pressure or BMI. 


3.2.2 Simulating Matrix Samples 


One hundred independent probability samples were 
drawn from the finite population. Each simulated sample 
included 1,200 subjects (20 simulation strata, 2 simulation 
clusters per simulation stratum, 30 subjects per simulation 
cluster). 

Matrix sampling was overlayed on each simulated 
sample by assigning each of the 1,200 subjects randomly to 
one of the six forms containing the core 1tems and one of the 
block pairs (1, 2), (1, 3), (1, 4), (2, 3), (2, 4), or (3, 4). The 
random assignment was carried out such that 200 subjects 
were assigned to each form. Thus, for each matrix sample, 
the core items were available for all 1,200 sampled subjects, 
whereas each split item was available for 600 sampled 
subjects. 


3.2.3 Estimation Methods Compared 


Point estimates from each sample in the simulation study 
were obtained using three methods: analyzing the complete 
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data for a gold standard; analyzing the matrix sampled data 
with no imputation; and applying multiple imputation to fill 
in the missing values caused by matrix sampling, followed 
by multiple-imputation analyses. For the complete-data and 
no-imputation analyses, the point estimates were weighted. 
For the multiple-imputation analyses, the same weights 
were used in calculating the point estimate from each of the 
multiple completed data sets, and then the usual averaging 
of the multiple point estimates was carried out (Rubin and 
Schenker 1986; Rubin 1987, Section 3.1). 

Multiple imputation of the missing split items was carried 
out using the sequential regression approach (Kennickell 
1991; Oudshoorn, Van Buuren and Van Riyjckevorsel 1999; 
Raghunathan, Lepkowski, Van Hoewyk and Solenberger 
2001), as implemented by the software package [VEware 
(http://www.isr.umich.edu/sre/smp/ive). Five sets of impu- 
tations were created by independently applying the sequen- 
tial regression approach five times, with ten iterations of the 
sequential regression algorithm for each set of imputations. 
The number of imputations is based on theory and experi- 
ence showing that five imputations is usually adequate, 
especially if the fraction of missing information is not large 
(Rubin 1996). With missing-data rates for the split items of 
50%, the fraction of missing information, which is roughly 
1—V.omp / Vimp» 18 expected to be at most 50%, as is borne 
out in the simulation results. Rubin (1987, Table 4.1) gave 
the large-sample relative efficiency of five imputations rela- 
tive to an infinite number of imputations as 90% when there 
is 50% missing information. A larger number of imputations 
would increase precision for estimating the between-imputa- 
tion variance (V,,,,) and the fraction of missing information. 

To account for the complex simulation sample design, 
main effects were included in the imputation model for 
simulation stratum and simulation cluster nested within 
simulation stratum. The logarithm of the simulation sam- 
pling weight was also included as a predictor in the impu- 
tation model, along with the core and split items. 


3.3 Results of the Simulation Study 


To evaluate estimates based on the matrix sampling 
design, two types of analysis problems were considered: 
estimating the population means of the split items; and 
regression analyses involving the split and core items. 
Properties of the no-imputation, multiple-imputation, and 
complete-data estimators across the 100 simulated data sets 
were compared with each other to assess bias and loss of 
efficiency due to matrix sampling combined with multiple 
imputation. 


3.3.1 Estimating Population Means of Split Items 


For the population mean of a split item, the simulated 
standardized bias of the no-imputation estimator was 
defitied™as~ (Ave,, — Ave...) / sD, where” Ave,,, 


comp 
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AV€.omp» and SD,, denote, respectively, the averages of 
the no-imputation and complete-data estimates and the 
standard deviation of no-imputation estimates across the 
100 simulated data sets. An analogous simulated standard- 
ized bias was defined for the multiple-imputation (MI) 
estimator. Table 3 summarizes the simulated standardized 


biases for the 32 split items. 


Table 3 
Simulated Standardized Biases of the No-Imputation 
and Multiple-Imputation Estimators of the 
Population Means for the 32 Split Items 


Frequency 
No Multiple 
Standardized Biases [mputation Imputation 
—1.4 1 
(—1, —0.6] 4 
(—0.6, —0.4] 5 
(—0.4, —0.2] 4 
(— 0.2, 0) 15 10 
(0, 0.2) 17 4 
[0.2, 0.4) 
[0.4, 0.6) 2 
[0.6, 1) 
1.4 1 
4.6 ] 
Total 32 32 


Because our matrix sampling mechanism results in 
missing data that are missing completely at random, the no- 
imputation estimators are close to unbiased. This is reflected 
in the simulation results by the fact that none of the absolute 
standardized biases is larger than 0.2. The multiple-impu- 
tation estimators generally have somewhat higher simulated 
standardized biases than do the no-imputation estimators, 
although the absolute standardized biases are less than one 
for all but three split items and less than 0.6 for all but 
seven. As a guideline for judging standardized biases, 
Cochran (1977, page 14) shows that a standardized bias of 
0.6 produces nominal 95% confidence intervals having 
roughly 91% actual coverage. Any substantial biases ob- 
served in this study when matrix sampling is used in 
conjunction with multiple imputation are likely due to 
deficiencies in the imputation models and not to the matrix 
sampling itself, given that the no-imputation analyses were 
seen to be approximately unbiased. With larger sample sizes 
in an application to an actual survey, the corresponding 
standardized biases would tend to be moved upward 
because of the smaller denominators; but the standardized 
biases might also be moved downward because of improved 
large-sample approximations. 

Loss of efficiency due to matrix sampling rather than 
using the full questionnaire can be assessed by comparing 
the sampling error of the no-imputation, multiple-impu- 
tation, and complete-data estimators (computed as standard 
deviations across the 100 simulated data sets). Table 4 
summarizes the ratios of the simulated standard deviations 
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of the multiple-imputation estimators to those of the no- 
imputation estimators, and the ratios of the simulated 
standard deviations of the complete-data estimators to those 
of the multiple-imputation estimators (the term “simulated 
standard deviation” of an estimator is used rather than 
“simulated standard error” to avoid confusion with the 
estimated standard error that could be obtained from the 
analysis of each simulated data set). 


Table 4 
Ratios of the Simulated Standard Deviations of the 
No-Imputation (NI), Multiple-Imputation (MI), 
and Complete-Data (comp) Estimators of the 
Population Means for the 32 Split Items 


Frequency 

Ratios SDy /SDyy SD comp /SDyq 
(0.5, 0.6] uy, 
(0.6, 0.7] 9 
(0.7, 0.8] 14 
(0.8, 0.9] 6 
(0.9, 0.95] 7 
(0.95, 1] 18 1 
CGa1,03) if 

Total 32 32 


Typically, the multiple-imputation estimators are more 
efficient than the no-imputation estimators, but the gain in 
efficiency is only modest, as indicated by the fact that most 
of the ratios SD,,, /SD,y, in Table 4 are between 0.9 and 1. 
Such modest gains in efficiency can be predicted roughly 
from the indices of predictive value based on data from 
NHANES II (displayed in Table 2), as follows. Because each 
split item is included in only half of the matrix sampling 
forms, it follows that the variance of a complete-data 
estimator of the mean of a split item should be about one-half 
the size of the variance of the corresponding no-imputation 
estimator. Dividing the numerator and denominator of 
expression (3) by Vy;, and setting Von, /Vxy = 0.5, yields 
2(1 — Vig / Vy) @S an approximate expression for the 
index of predictive value in this simulation study. For an 
index of 0.12, which is the median of the “Achieved 
Medium” indices in Table 2, it follows that Vy, / Vy, should 
be about 0.94. This ratio of variances is equivalent to a ratio 
of standard deviations of about ./0.94 = 0.97, which is near 
the middle of the range of ratios summarized in Table 4. In 
this study, because the multiple-imputation estimators are 
only modestly more efficient than the no-imputation esti- 
mators, and because the multiple-imputation estimators have 
some biases associated with them, the mean square errors for 
the multiple-imputation estimators are higher than those for 
the no-imputation estimators in 22 out of 32 cases. 

The simulation results on the efficiency of the multiple- 
imputation estimators relative to the complete-data esti- 
mators also conform with theory. Since V,,.,, / Vx; should 
be about 0.5, and since V,,, should be slightly smaller than 
Vx it follows that V.,,../ Vy should be slightly larger 


comp 
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than 0.5, or equivalently, that the typical ratio of standard 
deviations SD gmp /SDy, should be slightly larger than 
J0.5 = 0.71. Indeed, the median of the ratios summarized in 
Table 4 is 0.75. An alternative to the multiple imputation 
estimation is two-phase weighting based on core item esti- 
mators and their differences between blocks. Any advantage 
in efficiency from multiple-imputation estimation would be 


due to the additional information from the split items. 
3.3.2 Estimating Regression Coefficients 


The matrix sampling and multiple-imputation methods 
were also evaluated for estimation of the coefficients of 
eight regression models, which were specified to be similar 
to models that have appeared in the literature. The regres- 
sion models, which are listed in Table 5, had a total of 115 
coefficients. No-imputation estimators for the regression 
coefficients were not included in the simulation study, 
although some theoretical results on their efficiency are 
discussed in this section. 

For each regression coefficient, the simulated standard- 
ized bias was defined analogously to the definition used for 
each mean in Section 3.3.1. Table 6 summarizes the 
standardized biases for the 115 regression coefficients. Most 
of the standardized biases are small, with absolute values 
greater than one for only five coefficients and absolute 
values of 0.6 or greater for only seven. 

Table 7 summarizes the ratios of the standard deviations 
of the complete-data estimates across the 100 simulated data 
sets to those of the multiple-imputation estimates, for the 115 
regression coefficients. Separate summaries are displayed by 
whether the regression models involve split variables from 
only one block (Models 1, 2, 6, and 7) versus two blocks 
(Models 3, 4, 5, and 8). A larger proportion of the ratios are 
close to one than was the case for estimating means (Table 
4). In addition, for several regression coefficients (partic- 
ularly from Models 3, 6, 7, and 8), the simulated standard 
deviations of the complete-data estimators are moderately 
larger than those of the multiple-imputation estimators, and 
for one coefficient, the ratio is about two. Finally, there are 
four regression coefficients for which there appears to be a 
substantial loss of efficiency due to matrix sampling, with 
ratios less than 0.3 (one each from Models 1, 2, 5, and 8). 
The ratios close to or larger than one could be due in part to a 
lack of fit of some regression models to the complete data 
and a better fit of the models to the data completed by 
imputation, with the latter resulting from an imputation 
process that is based on regression models. Moreover, the 
two smallest ratios occur for regression models involving 
split variables from two blocks, for which the fraction of 
subjects in the matrix sample with no missing data is only 
one-sixth, as discussed further below. 
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Table 5 
Regression Models Used in the Evaluation 
Type of regression model Dependent variable Variables recoded to create Split variables in the 
predictors including interaction regression models. For each 
terms. Each model also includes an __ variable, the number in the 
intercept term. For each variable, parentheses indicates the 
the number in the parentheses block containing the variable 


indicates the number of regression 
coefficients associated with the 
variable 

1. Linear GIP HSSEX(1) ,HSAGEIR(1), GIP(1) 
DMARETHN(3), and GHP(1) 


2. Logistic HAF10 HSSEX(1), HSAGEIR(1), FEP(3) 
DMARETHN(3), FEP(1), and 
BMPBMI\(1) 


3. Logistic HAF10 HSSEX(1), HSAGEIR(1), FEP(3) and G1P(1) 
DMARETHN(3), HAD1(1), 
HAE3(1), PBP(1), FEP(1), CHP(1), 


and G1P(1) 
4 and 5. Linear SPPFVC HSAGEIR(1), DMARETHN (3), SPPFVC(1), HAR1(3), and 
HFA8R(2), and BMPBMI(1) HAR3(3) 


[By gender (HSSEX), and 
restricted to never smokers (HARI, 


HAR3)] 
6 and 7. Logistic HCHP (1 IF CHP>=240 HSAGEIR(2), DMARETHN(3), (HAR3, HAR1)(3) 
AND 0 HFA8R(1), BMPBMI(3), 
OTHERWISE) (HAR3,HAR1)(2), 


BMPBMI*HSAGEIR(6), and 
DMARETHN*BMPBMI(9) [By 


Gender (HSSEX)] 

8. Logistic HACIE HSAGEIR(5), HSSEX(1), HACIE(2), 
DMARETHN(3), BMPBMI(4), (HAR1,HAR3)(3), 
(HAR3, HAR1)(2), SPPPEAK(1), SPPPEAK(3), and 
and SPPFVC(1) SPPFVC(2) 
Table 6 


Simulated Standardized Biases of the Multiple-Imputation 
Estimators for the 115 Regression Coefficients 


Range of Standardized Biases Frequency 
—5.2 | 
—1.5 l 
—1.3 l 
—1.1 | 

(— 1, -0.6] 2 
(— 0.6, — 0.4] 2 
(— 0.4, — 0.2] 3 

(— 0.2, 0) 52 

(0, 0.2) 44 
[0.2, 0.4) 6 
[0.4, 0.6) l 
[0.6, 1) 
ae] l 
Total 115 
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Table 7 
Ratios of the Simulated Standard Deviations of the Complete- 
Data Estimators to those of the Corresponding Multiple- 
Imputation Estimators, for the 115 Regression 
Coefficients, by Whether the Regression Models 
Involve Split Variables from Only One 
Block Versus Two Blocks 


Range of Ratios 
(0, 0.1] 
(0.1, 0.2] 
(0.2, 0.3] 
(0.3, 0.4] 
(0.4, 0.5] 
(0.5, 0.6] 
(0.6, 0.7] 
(0.7, 0.8] 
(0.8, 0.9] 
(0.9, 0.95] 
(0.95, 1] 
(1, 1.05] 
OS 12 tl 
Chea 
(1.2, 1.4] 
(1.4, 1.6] 
2.0 
Total 


For regression models involving split variables from only 
one block, the theoretical efficiency of the complete-data 
estimator relative to the no-imputation estimator, that is, the 
ratio of the variance of the latter to the former, is ap- 
proximately two because only half of the subjects in the 
matrix sample will have complete data on those variables; 
and for regression models involving split variables from two 
blocks, the theoretical relative efficiency is approximately 
six. In contrast, the respective simulated relative efficiencies 
of the complete-data estimator relative to the multiple- 
imputation estimator, that is, the inverses of the squared 
ratios summarized in Table 7, are less than two for 64 out of 
69 coefficients when only one block is involved; and they 
are less than six for 44 out of 46 coefficients when two 
blocks are involved. Thus, the multiple-imputation esti- 
mators are generally more efficient than the no-imputation 
estimators for regression problems. Nevertheless, the large 
losses of efficiency of the multiple-imputation estimators 
relative to the complete-data estimators for some coeffi- 
cients as well as the apparent gains in efficiency for other 
coefficients are worth further investigation. 


3.4 Additional Limitations of the Simulation Study 


This section briefly discusses some additional limitations 
of the simulation study and adjustments required during the 
implementation of the study. 


Frequency 


One Block Two Blocks 


2 
1 
3 
2 3 
2 7 
4 4 
2 3 
29 8 
20 5 
4 2 
3 2 
4 
2 
1 
69 46 


Originally, two questions about two conditions, gout and 
lupus (HACIM and HACIL) were designated as split items. 
Due to low prevalence of these two conditions in the 
constructed finite population, many of the simulated 
samples had no subjects with these conditions. After a few 
preliminary runs, the designations for these two items were 
changed from split to core. In general, in situations with 
limited sample sizes, conditions with very low prevalence 
rates may need to be designated as core items. In addition, 
due to issues such as some split items appearing in 
NHANES III but not in NHANES II, as well as logical 
linkages between some split items, the number of split items 
per block in the simulation study varied slightly more than 
intended (from 6 to 10). 

In the regression models listed in Table 3, the number of 
predictors ranged from 8 to 27, because some of the 
regression models included interaction terms as predictors. 
Even with the sample size of 1,200 for the simulated 
samples, some of the complete-data estimators were 
unstable. This was due in part to small sample sizes for 
some combinations of variables that affected the estimation 
of interactions. Note that in many applications of matrix 
sampling to large surveys, complete-data sample sizes 
would be substantially larger than the size of 1,200 used in 
our simulation study. 

The Monte Carlo standard errors of the simulated 
averages in this study are approximately one-tenth of the 
standard deviations of the individual quantities across the 
100 samples. However, the standard deviations across the 
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samples varied widely from one estimand to another, due to 
differences in scaling. For example, the simulated standard 
deviations of the complete-data estimators of the 115 
regression coefficients ranged from 9.8 x 10° to 1169.6. 
More precise estimates of bias and efficiency could be 
computed based on a larger number of simulated samples 
than was used in this study. 


4. Discussion 


In this paper, a method was developed for creating matrix 
sampling designs that have the property that the items 
included on forms are predictive of the items that have been 
excluded. The feasibility of implementing such designs in a 
complex, large-scale health survey was demonstrated via an 
example involving the National Health and Nutrition Exam- 
ination Survey. Matrix sampling designs, in conjunction 
with multiple imputation, can be used to expand the scope 
of a survey without increasing respondent burden or unduly 
increasing the burden to subsequent data analysts. 

In the study involving NHANES data, the multiple- 
imputation analyses of data from the matrix samples were 
modestly effective, with minor evidence of bias and with 
greater efficiency than simply analyzing the matrix sampled 
data without imputation. The increased efficiency was 
especially evident in the context of regression analyses. 

Matrix sampling in the NHANES example typically 
resulted in large losses of precision compared to what could 
have been achieved with a longer, complete survey (i.e., no 
matrix sampling), however. This finding, which is in 
contrast with the more promising results obtained in other 
applications of matrix sampling, highlights the importance 
of including good predictors of the split items in a survey. 
For example, an application of matrix sampling to an 
educational survey (e.g., Beaton and Zwick 1992) has been 
much more successful, because the split items are highly 
correlated responses to questions designed to measure the 
same trait. Raghunathan and Gmizzle (1995) also 
demonstrated much greater recovery of information on 
omitted items in the context of a health survey. 

The items in the NHANES example were chosen mainly 
to represent a variety of important health characteristics, 
without much consideration given to their ability to predict 
or be predicted by other variables. Many of the split items 
represented rare illnesses that are not well predicted by 
common medical conditions and standard laboratory mea- 
surements; in hindsight, these variables were not good 
candidates for split items. Variables representing rare events 
may also cause difficulties with many common statistical 
methods that rely on large-sample approximations, making 
them less amenable to model-based imputation. 
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Better candidates for matrix sampling designs are 
“panels” of inter-related items. For example, matrix sam- 
pling techniques can be useful when there are multiple 
measurements of the same (or closely related) quantities, 
and it is desired to collect some of the measurements for 
subsets of the survey respondents due to cost and time 
considerations. Some rudimentary forms of matrix sampling 
are already being applied in such settings, and there may be 
substantial improvements possible by applying methods, 
such as those developed in this paper, that aim to exploit the 
associations among the variables. 
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onward) as a guide and note particularly the points below. Articles must be submitted in machine-readable form, preferably 
in Word. A paper copy may be required for formulas and figures. 
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Layout 


Manuscripts should be typed on white bond paper of standard size (8% x 11 inch), one side only, entirely double 
spaced with margins of at least 1’ inches on all sides. 

The manuscripts should be divided into numbered sections with suitable verbal titles. 

The name and address of each author should be given as a footnote on the first page of the manuscript. 
Acknowledgements should appear at the end of the text. 

Any appendix should be placed after the acknowledgements but before the list of references. 


Abstract 


The manuscript should begin with an abstract consisting of one paragraph followed by three to six key words. Avoid 
mathematical expressions in the abstract. 
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Style 


Avoid footnotes, abbreviations, and acronyms. 

Mathematical symbols will be italicized unless specified otherwise except for functional symbols such as “exp(-)” 
and “‘log(-)”, etc. 

Short formulae should be left in the text but everything in the text should fit in single spacing. Long and important 
equations should be separated from the text and numbered consecutively with arabic numerals on the right if they are 
to be referred to later. 

Write fractions in the text using a solidus. 

Distinguish between ambiguous characters, (e.g., w, @ ; 0, O, 0; 1, 1). 

Italics are used for emphasis. Indicate italics by underlining on the manuscript. 


Figures and Tables 


All figures and tables should be numbered consecutively with arabic numerals, with titles which are as nearly self 
explanatory as possible, at the bottom for figures and at the top for tables. 

They should be put on separate pages with an indication of their appropriate placement in the text. (Normally they 
should appear near where they are first referred to). 


References 


References in the text should be cited with authors’ names and the date of publication. If part of a reference is cited, 
indicate after the reference, e.g., Cochran (1977, page 164). 

The list of references at the end of the manuscript should be arranged alphabetically and for the same author 
chronologically. Distinguish publications of the same author in the same year by attaching a, b, c to the year of 
publication. Journal titles should not be abbreviated. Follow the same format used in recent issues. 


Short Notes 


Documents submitted for the short notes section must have a maximum of 3,000 words. 


"SJOU YOO ¢ SHI Nev MOAR JUDATOP SOAdIG SUONVOTUNUIWUOD Sap UOT} BT INOd sTuIMOS syUOWINSOP So] 


SdAQ1G SUOTVITUNWIWIOD 


“syU9991 SOJOUINU 
Sd] SUBP 9SITQN sapOUr I] OIAING “BUOT NL S}LIO9 OQ JUOATOP SoNAdI Op Sony say ‘UoHRognd sp sguue,] eB “qa ‘Oo 
‘q ‘e somo] Soy yuRINofe US s9UUR OUTOU OUN Pp jo INANE SWIQU UN,p suOHedI[Gnd so] JonsuNsiq ‘onbisojouoIYS orp 
Ud 99 JUSATOP M9INV SUIQUT UN .P soy) soy Jo oNbHSQeydye sipsJo Ud oO JOP 97x9} UN.P UY ey] ev oIydeIsOT[qIq eT 

‘(poy aded ‘//6]) Uesyoo, :a[dtuaxq ‘soud9yoI ve] Soide ofjanbe] sonbrput ‘99310 }so yUOUNDOp UN _.p onsed oun 
Ig ‘woKRorqnd ap ayep eI 39 SINaINV Sop WOU J] JasIOgId JUSAIOP 9}X9} 9] SULP So}TeT XNVALI] SON P B SOOUSIZJOI SIT 


aydeasonqig 


‘(slog osoTUUDId eT Inod soudIIyFOI Wey A nb osessed np seid SoIQSUI 9.149 JUSATOP SII “JUOUUOTPULION) 

‘O}X9} 9] SULP JOINBIJ JUSATOP S]I NO PoIpUd,| 9p UONRoIpuT ouN JozIOd ja sagiedgs sased sop ms onered JOAIOP SI] 
‘(xnea]qe} sop yney Ud 39 sons sap seq ne) s[qIssod onb Jryevorydxa Issne 

dK) UN JoVOd Jo Saqvie SOIJIYS SOP SdAV JINIISUOD SIPIO UD SNOISUIMU 39 SNO} JUSAIOP xnvo][ qe} Sd] 19 SOMBIT SIT 


XNVIIQR} 39 SAANSL 


‘SJOUI SOP IJOSSoI sey INod sgstpN yUOs sonbiyey soigjoVIed sa] 

(1 1£0 ‘OQ ‘0 £ © ‘A OUTOD) SNBIQUIe SoIQdeID Sd] JUSWIOITLD JoNsUNsIq 

‘anbijgo a1eq oun Pp opre | & 9}xo} 9] SURP SUONOBJ So] TLIO 

UIO] SN doUdIITOI Wey A Mone | Is LOIp L] B oqeie SFIS uN Jed JyNdIsSUOD IPO Ud sagjos9umu 

yo Jedroutid 93x90} np sagredas a9 JOAIOp soyuUeyodumt 39 sonsuo] suonenbs sa] ‘ajduuts sovdsa un e aspuodsai09 
JUSAIOP 9}X9} dT SUP SoIa}ORIeO soy sno} seu ‘TedtouLId 93x90} oJ] SULP JoMBSIy JUSAIOP soyMOD soyNULIOJ sax] 
‘QJa (.)80] 39 (.)dxo SUUIOD sfouUOTsUO} 

SOTOQUIAS Sa] INOd Jnes ‘oe.NUOD UOTJBOIpUT oUN,p suTOUT ev onbiTey US souTLIdUII JUOJEs sonbyeursyyeU sajoquIAsS Sa] 
‘S9IBIS Sa] 19 SUOTLIAQIQR So| ‘soded Sop seq Nv Sa}OU Soy IOWA 


uonoepay 


cs 


“QUINS9I Oo] SUBP sonbyeuUsyyeUT 
SUOISSOIAXS Sd] JOA “S9[D SJOW XIS B SION op IAMS oydesseIed uN.p ssodurod guNso1 UN Jed JOOUDUTUOD POP 9}x9} IT 


guinsay 


‘orydessorqig ev] Japsooid STeUr SyUOWISTOIOWIOI Sd] SANS JOP 9xouue 9yNo |, 

‘0}X9} NP ULY BT B aNTeIed JUDAIOP SJUDWIIDIOUIOI SIT] 

‘91X9} np oded osoTWUAId vB] Op seq Ne 9}0U OUN SULP JaMBIy JWOAIOp Mayne onbeyo op sssorpe | Jo WOU YT 

‘soudoidde so.ny sop yuepiod sag}019UINU SUOTIOAS UD SISIAIP 9.99 JUSAIOP $9}X9} SIT 

‘Moyne jno} sonod % | SUIOW Ne .p SdsIeU Sap ddAPv 39 JNoIed OUBT]JO}UI a_qnop ke ‘yUoIOTNES 

d0eJ ouN IMs ‘(ssonod [] sed 7%) prepurjs yeuLIOJ op ouvIq Jo1ded un ms sorydesso]A}Oep 99 JSATIOP $d}X9} SI] 


uoneWISI1g 


"t 
a! 
vl 
3a 
Gl 
Le 

¥ 


‘sonbrydeis jo sapnuttoy soj nod asmbel a9 wWeunod Jsided UOIsIOA OU) “PIO JUSWUATQvIgJOId ‘o}xO} Op 
JUSWIDTV.Y IP SIOTYOY SP SUIOJ SNOS STUMOS dQ JUSATOP Sopor}e Sa] ‘snossap-1o syutod sa] J9}0U 9p 19 (T ,N ‘6 ‘JOA np sed 
v) ajanbua,p sanhiuysa op yuso91 OIJUINU UN JOUTUeXa p aiglid ‘anjowmos a] Mod 97x} 9OA JoTYydeSo[AjOep op JURAY 


SALXG.L Sd NOLLVINASAYd VT INVNYAONOD SHALLOW 


: 
‘ > 


a Sa ene etre 


7 ee ere era cue Ege D eas i ReaeNs eT Tr, ee 
7 = 
er * GOGO wotreiy sexta Pag Khe | 


q f 


ea 7 - 
wre nh Gan rin ~ oe congas weeny POST eG Weve rye Hie 6 ot mM +. on eiy 
. | HL) Og y CRA GH TOO, iG) oe Qe? UA Ww Par 


BOS pest ee 9 * Laeyeaaen et wheelers} qiocne iad oy oy pu Cr ee a 
QPepUEs, pe Pe AbiAin! cm et) | io tie. ee CODERS ep) DO Oo RRY © 0 B®! a hu, 
2) bs om fontter) y NWA ANT Sang Pepe a em, TD 4) ere; 


a . = ws WIIG s Daur by, ann Spt Ow a 

iy ic) & €0iGe Mm ¢. Vi MNiwwg p41 *'\s AU San) viiva DP a 
glte* ry 7 | sre “aT eg ey | “re oe > my wy , wee 4 nur eee Aga 41) SHITE) Wey - y 
f VTIVIVS WE), € LLEE tt CORKS Fil hewrh i i 


“iin 2p @ btf ee - “/ anleeee) a9 > 4k (EH Fale dea EAU Wo Gt Ma GS Py POO ah 


rs 66 a we Pn id > 7 ; - a!) ry ye (WA) 9 a wt, 9 ra e J 
~ 5 wr) wa Ay ry ee wit 7-9 
ate 
a eet age af Pe b> Qe—6 on Weaeral rT tiene ge OeG: micad)) oa ve 3 yiie/(M eA Or ~y pie OVie4 
cf iy) “ar 
or ve i> @ i) hamipg Pare e ; » aya) Ve y “aly a oe 9 may, rT) » ond ( @ if 
‘ Madi val | [ ( “th Fe) 4 4 
oo’ rie =e Oe , my pes + . to site pear op "a mse ory awit’ ie * 
Clie } ,* 
bisa =a cert qi wap y ee ae Puhfes 4 toy AR (PMc: (Oe wr" 1h 
y rich ees ie Ey ’ ; oy 


- i le 6 han 7 *1gPuey Pampa eee 0) sate al cee de ts Lng ta A awe 
SVK SOWA © MYERS PO sve li Os 


Sat Diy) ee gee ney “pe “9 owe : oS? Sd Aled © yh ipt si chp S RN on Amiga pals fer ies Oa.) 
ah. le ie A ee 


Gab Tr agepmagily) | ocupw oy") uh “pe ae | 


RUCal tod 


ee §© eee - 2 RQ eee = ee _ 


SINE (oe AY Vege) | 


it Ry a 
ea ils 7 
on i ie 7 iy Ai ius ; " 


AL ab a 
arr Lg - 


Z i 

mi 7 t 

7 as 

. 7 a mie Fe Ri aw) 
yen ul i, me ae 


WT ee 


ms wom 
cs ay ’ tho iv 
ne a | . heal Pa Pa 

ee ain a A Aaa sh) mee eonvacte ss aca ‘~{' 

ty Vey oe Whe Ne RUT ORURAT aE_D 70. Rn cma Meng testy ro ethers) 
> Why We Sie ova ape amnP FA Fay WH OOM had Le Ayer) ay Rh tal) amp oy “ 7 a 
Vp SP "fant TR eh y ayia OS ay st Wy gad aye anne ‘ome a 

fay tern ae 0 ae Nay be ACRE Dery ecpeRt Bi] Mr Npe sana d St) oy ely ang “HITMAN MITA, 9 HF 


Chay apenas] a ash of cueehouy gan poet 4 wall anata ny aha? aalphny Spar ‘ater i 

wees co vin eonie ras RO Rt Oe Fp, (Op Taupin ah oe  Degahestins SNP Uy swe Racenras ind 
Lape eae seg eS sabteeally: wap ey ell? Ayia! oe payetayd em 

TR Ase ee asl Ui A way anh POU S PUD. att niet. * wna 


‘enaaes © 


a i “a SMR vor ¢ meth) m wits sandy nit anugrn 4 { 
Be Al VT H » Ae digian oe Ji way LOMO 29 dare 
lx antic Mt, Rf ng RR ni 04 og. | 
MOT RNA WaPo? PT Passe ii iy plied qi) US CO a tat 
narra na ty Gyandiog ayy Mowep ocean i) sete ecttwanthe er Dp a a aa 
i i ei Gey Qe Ae mm en gow e ra se ray Went June sopra say he 
} . . i ; holt) Tv 10 0 Re ORI? BRU 
yi 4 0) Oath), ORD “AIL WO TRAD (Pe ‘ Kar uy Usaha 3 1 we « roy e leh iM uy hyyeIK mylt <1 oR qRAS 7 
» pee Ot TD Mia pal aay eT cae EA 
i - 1) 
van op aia 9 pele = 
Oo eee HY mes oy) prin spe Nae wo: pace je -regr Gn and ORME HOP 
; 7 7 fa _ 
—- 3 


= 
7 


7 
a 


* eayrnbnTt yy: vee Rory 


eae thy DA x % enryepad wen OPE AT #9] Phar Hce 

AUEMNp HTP ae eggonkl TERRA Ae we 

4 Hp dl appt” @, Aye vial Pte ses qtr: sciegy aaartyy srs samnew ogo a Oma Ca Be 

“timc tle Golie tgy @aitaen’h enpMUeneNE RLF WO GT NR RNAI win 

“SHARIN ty ONE he) AMMA eo en en cepa jos pcp) ag sagan RAN 

op ane we (akon 14. Sed SR) Damen atti Oe ee nie linc iat fi 


wilh \idnieahiadaandanidaeaaaa 

Ca MOR Re ging ap ialing ner? eva ns AR COREE rt Om ae 

4 mlhaRe* f Agadlninay ane § Wry page tin praevia iy nF i hartthege 
a We Se 


Re - 


. Po. hoa 
ne sania mila vers 
Wh Dh 
oir aus 7 i 
7 ris | u 
b ae 
m7 i. ne ; ; 


a + ora sad Soest 


. at Pr 
= ps ash Le | a ie 


EEC etree eet eeeeeseeneeseenecenesssresseasccseessensseacasecscensesecessesscoasonesenconsecneessenscenssasecsenseeneny sONSHeIS JO [eUINOL URIPeURD aU], 0) ssod0e OUTTUC 


ZES eee reer eer e eee eee eee eee eee eee eee ee ee eee eee ee eee eee ee eee eee ee eee ee eee eee eee eee eee eee eee eee ee eee eee ee ee ee ee a quowsuUOQe .p sIely / soqes uonduosqns (L007) S¢ ouNyo A, 
I€s Reece ee erect eee ener anette eee eee ee eee eee EEE EEE EEE Ese eee eE EEE SEE EEE ESSE EEE ESE SEE EEE SEES EEESEESES ESSE SEES ES EEHEE SEO EE ESE ES EE SEES EE EES ontered e SofoIV / sioded SUTWODYIO 7 
Las eee eee eee eee eee eee eee eee eee eee eee eee eee eee ee eee eee eee eee eee ree weIs0lg OSvITOY JOOSU] oTH9IS ueseuryo ou} woy eyep youl SUI[Poo jo sIskjeuy 


HLINS 11095 299 NONUAA 9° “COOMATLSIAL PreMoH “APUALSA “UY PIAS 
[TS PO e eee e neem eee e eee e erent eee eee ee eee esse eee eee eran eeesseeseseeeesens (a];ouowWod eisoihodse’T) ouru0d eR] op asdvoodirvo 3] qnod SOTIIO}S SQ}OOSUT .p 
osepueds p sumueisold np 9}108d JO ,| INS SIOBIOA Sap sanbystgjoeIed sop jo o1ydeiSodo} ve] sp soUdNJUI | op opmyq 

LSAATS [ed-sinoT 29 NITON-ANGA ofenuewng “ANSHHON ASML “ATOIVG ween 


00S eee eee eee eee eee eee eee eee ee eee eee ee eee e eee eee eee eee ee ee eee ee eee ee eee eee eee eee eee eee ee ee ee spreyolo ueseueyO ul OUSpIOU your SUI[poD 
NVA ‘d cureueyD 2 TTD lured HLYOMSNIV Ney “OOH.LVN Ynosey 


Bop oe aaa es eIquinjo?y Ysijig jo AqyeA UeseURYC OY} Ul JUOWIOSeULUN YJOW SuUT[pod sAOoIduT 0} UOnvoT|dde STD V 
MATV AVY PPOL 8% HLINS 19S “GOOMATLSIHL Ple“0H “NONUAA 994 


CGpee OF ner aT WRIBOIY WeRIdY JOOSU] II1I9IS ULSeURY_O 9} Jo AovdTJo oY} puke soULPUNe YOU! SUI[POS 0} Poye[oI SoTquiIeEA 
AGUALSA UY elayss 


iy" poietamy sai wanton ye steer poy}oW UOBOIISsE]O & YIM ‘ZuNseoo10y SUIT} JOARI] UID} JOYS pue uondiosap SuDpyyen peoy 
ZANDIAGON SMT Y ATTAIAVI LR “VZV Fd “SAANOT [4A UeeL 


Cop lo PIR sre Sossoo01d SOURTIVA-d}IUIJUI JOJ suOTOUNy ssuOdsaI ss[nduil JedUT]-UOU pue SUOIsSOdWIODEp JeUOSOYIIO SUONS 
TH ef Gemevos 


18% eee CeCe eC eee eee eee eee eee ee eee eee eee eee eee eee eee Cece eee eee eee eee eee eee eer eee eee eee ey UOT}]N[OAUOSEp Aytsuop oandepe JO} Joyeuso yse.1yUOO pozijeusg 
NIdAVL 990J-9He WW 29 OTOHNAZOU $944 “ALINOO suuerqey 


I Iv eee eee e ee eee eee eee eee eee eee eee ee eee eee eee ee Tee CeCe eee CeCe eee eee eee eee eee eer eT yovoidde Jeuoyoorp e :suOTINGUISIp pomoys oyeLeA NUL SUIQIIOSOp uO 
THALS fA Ve 2 Vad aaHA SVL 980 


(vag io. 618 6/6 ails finale \e(ejele] esis) Sioleipiniafele’e/elslpioieipisicte,ese)eieieis e's sia SIOLIO JUOWTOINSPvOU yum sjapour JUOTIOYJO0O-3ulAIVA ul UOTeUIT}S9 [ertuousjod [eoo] payo91I09 
NAHO leuled 2 NOHZ 840% ‘NOA Suoyury 


ELS Poe ene e eee e erence eee eee een esse reese eee see esses sees esesseeesessesesesee sjopouwl yeororesory ul siajowurered QOURLIBA Joy SUOTINGLYSIP Jord DATILAIOSUOZ) 
AVNOVW 'D 8ULX 29 NIVSSOH peyeys ‘NOSAV.LSND [ned 


Beer wetter cece wns TAT Pe SRE Pt sKOAINS xo[duioo IOJ S[PAIOJUI DOUSPIUOS ONLI Pooyloyt] jeormduio-opnesg 
OVU WNL AM OVgsueyD 


9007 2Aquiajdas/1squiaj}das ‘¢ “ON ‘pe UINTOA 
SHYAXILVW SHd ATEVL SINHLINOO 


amnbysynejs op suusipeuey snaoy eT sdNSHLIC JO [eUANOL ULIPeULD oY 


rag eee eee eee eee eee eee eee eee eee eee ee eee ee eee eee ee eee ee eee eee ee eee eee ee Tee eee eee ree eee eer ere errr rrr reer eer onbysne}s op ouusipeurs OnAdI cal op oust] ud SOOIAIOS 


Qo greettreeetteeeeeecsnnneeccesnnececeensneeeeenuunceceesnnssccessnnssceeeeuneseeeeosunssereeannsserceansesserseee sonstielg Jo [euMor uLIpeue? sy, 0} ss200e OUTTUG) 
LG greettteeneeeteteeeccnnnnneccenunnceccnnnsscecennnsseceeanunacecteonusscteccnnssceetenuusccecennssseteanunsaceesnnaserceensnsseessse anrered eB sojony /sioded Surwooyy104 
[pec creetterneeetteneetenncessnnaeccnnnseeconnseccannscecsunscecennsecessnecceunseecennsssecannscetenneetennees s[2pOUl FIYV Ul UoNeUTNss pooyrayr-opnasg 

Aa Pea HAIN Beyouesy 
LEC ey ae ens SOTISEIS IOPIO JO SJULJTWIOUOD II9y} pue SUOTIBAIOSQO JUOpUSdap AT[VOTOUIWUAS poJOpIO JO sIsATeUe UONR[IOD 


AaT sundp-YeH FY VNVIA ‘D'V Sopse 


L 11 o ae trapaniare sacmaces co eg eee arene ee agian splaqy wopuel aoeds-o]e0s Joy ainpssoid wonso}ap [eusis ueisokeg V 
IHOOOTVEYOON AeWeIS 2 ALVHS [eI ‘INVHOY PHeA W 


GOT eterteietseeescanecnecenccaneccucennecousceuseceuecennecuseceusccanecancensccaneceuscasscancansacanecgesstesseg sUOTOUNY [12] PIA UONUISO [RAIOIUT 
THANO 9Ue9L YP VZNd A904 


6LZ Beem e eee meee eee e meres seer eee seers ees ese ese EEE HESS ESSE SESE E HEE EE EEEESESESEE SES ESE SEES SEES EES pooylfoyq] powsiom Aq JOUdIOFUI ueisokeg suryewurxoiddy 
ONVM Suesorry 
19Z errr rere rere rere ee eee eee eee ee ee eee ee eee eee ee eee eee ee eee eee eee eee ee ee ee eyep eulpnyisuo] Joy s]opour Jeoul] pozije1ous3 ul JOUdIOJUI isnqoy 


VWHNIS “So Aofues 


Sy dibs oh Wane atk ae tt en reer fa eee de ae ec sula,qoid eyep SUISSTUN ul siqjouresed UOISSOIBOI jo uoneunys7 
SUAHLNULS ‘V eYWAD 29 HSIDTIOW “T Prevod 


eZ PR meme eee eee eee e eee eee eee a eee esas aes eee eee eee eseseee ese ese eee eeessessesseseees sosoujodAy oj1sodui0s 9, dures-0M} JO} $189} Jequonbes jo sseyo Vv 
NIASSNH Apexapqy 2% AVEWOD UPA 


€0Z eee eee eee ee eee eee ee eee eee eee eee eee eee eee eee ee eee eee eee eee eee eee eee eee eee eyep AdQAINS pue Jepour sprezey jeuonsodoid om uo poseq stskyeue JeATAINS 
SSHIMVT A PIeter 2? NVAACNO" YeNsHYD 


L&I Rene meee eee meneame eee eee eee teeter ee ee eee eee eee EE HESS EE EE ESE E SESE HEE SEES EES E EEE EE ESE EEE EEE EEE EEE HE EES SOOLeUul uone}o1 c x € JO} 160} 81-) fab (ee) pue UOISSOIBOY 
ONVHD POL 8 LSHATS [hed-sino'T 


9007 umfjeune ‘7 ‘ON “pe euNOA 
SHYAILVW SHC ATEaVL SINALNOO 


ImnbySHR}IS sp sUUsIpeUR, sNAdY vT SINSHRIC JO [VUINOL ULIPeULD IY] 


dS*GIS@)SO! 0} p9}d0IIp oq pynoys suondidsqns pue suorssturgns noge sosnbut [Ty 


ocean pained sco Cie hoursy pa yep set pyc) soar pee Poe: fame ae MOIADY SIVMIJOS pue Yoo 


6CE Seem eee eee eee esenneeeeeeees esses seen e eset sees ses eesseeeEe Es ESTES OEEEHEH ODED SETS OEEEEEOE ESTEE ESEESEEEES SES SSESSESEESES SSE EEESEEEEEEE ESSE EEEE OSES SHEE eeeeeees alia soysuns 


SADAING GoM [OUR JONjUNTOA JOJ sWIDYOS SuYSIO\\ & se yUoUsn[pY o100S AjIsuadoig 


ST ¢€ Seen eee meen eeee secre esses eee esses e EEE EE EOS OHE HES OEE EHO EHSOSEHH EEE SSOHHEH EES ESEEE ESO SEES OES EESEEEESOESESESS OSES ESOS SO SS OEOSSEDSE OSES SEES HEE HEHEHE ESE SEH EHS OE SEED dISOTeH) LARA 


ADAING SUTTUGC Ue SuLMC pooudtiodxg Usping pure jsosazUy JO S}OoLFY :q9\ oy} UO synodoig 


FEIN cans a eeecne Faresete arash nceesens Shigeo ncesn sth evaseeh hase eaceseedasne tases eats thtr tres PepyOY ITV pue yur “AA joey 


(dOURTTIOAMS YoY [eUCHeN poseg-qqy ue ul uoedionseg saoiduy sopoyy Advis [ley] pue gop ued 


vag CORPO HOR m eee eee OEE HEEL EE HEE SEO EEH EES EEH HEE EES EO EEE EHS OOOH EES OSESES EEE OE SEED OSES Joupny W QOUdIMET pue “Z\ISSTT aN VWoqoy UOISTe AA ae TE 


Ayyendy Adams Jo suondasiog 
pure uoneiodoo,y Adamng UO sUOnRLIeA UONEUSSOIg dITeUUIOT}SON?) paseg-qo MA JO soUdNJUT OY], 


SPT eee cece e ec ceceereceeeeesesesreescseseeescceseeseseees Aayohog Aolpuy pue ‘neosuesimo |, 1930 ‘rodnod | YUN ‘peluo,) 79) youapoly 


SASAING Gd \\ UI SoINyea{ UONROLIe[D JO osn-UON pure os—) 


Wg i ae TY Meroe Gr Cee cs Con | cad Fy 27 Ren uloPy ‘CG UeyWeUOL pue seWOY], yf [[epuey 


Jolavyag poviodal-j[a¢g Uo yeuJO,J ssuodsay Jo syayq :{[eywaprouy AyoIOP\ 


I IZ Peet eeeeee eee eee errr eee reer reer eee eee Creer eee eee eee eee e rere eee ere eee eee eee eee ere reer eee eer rere e rere eee eee ee eee eee eee eee ee ee eee rere rer relg Auuyor pue melg prempy 


sdnoin o1ey Jo} Surpdures suoydayay - go Ay owes peng 


161 Pereeere rere eee eee eee ee eee eee ee eee ree ee eee eee ee eee eee eee eee rere eee eee ee eee ee eee eee ee ee eee eee eee eee eee ee eee eee eee IPJOAsoo'T YI90H pue YsoM1o0H yg 


SADAING Gd UI SOSO'T Josuods AdA.MS pure ‘s1OJeOIPUT 
SsoISO1g ‘syuOUIN}eIS YJSsUNT ADAINS ‘UOHezITeuOsJeg JO s}ooIF_q oy} UO ApNys [eyUOWILIEdxY UV 


ple ae eater neice wana Sesto scrron aa sarc 2e eo icoceh rat Tear Seas pase snoar str kc ipa ier aareaeree ear r ets UDs0YIS presley] pue seev.j Ud}ssOY |, 


ZOOT WOTIDOT_ [eJOpo,J ULULIADH oY} JO 3x9}UO0_D dU} UI poyonpuOD 
SAAING OUI[JO puke sUTTUG Jo uOsTIedu0D VY - Ysnoug jou st ga dy} UO dITeUUOT}sON¢d) & SUING 


OR eee e ee eee e eee eee eee eee eee He eee ee EEE ETOH HHH HEHEHE HEHEHE EHE OSHS EEEHEEEHH HHO EEEEE EHH SEH HEH EEE EHEEH EEE ETOH EOEEHE EEE EEEEEHEHESEEEEEE SEE EEE EEHSEOEEOEOHEHHESES OE ESESEEEEESEEEEHE ESE OES dOVJoIg 


9007 ‘7 “ON “ZZ UINJOA, 


19] eee e eee eee eee ee eee HE eee EEE OE SEH E EEE EEE HESEEEEEHES DES EEHEE ESE SES SESES EET ESEESESSEEE SESE OOE EET SEESEH OE OES OSES EOHHES ESOS SEES EH OEE HOSEESHE SEO E EES SMOTADY OIeMIOS pue yoog 
6SI eee eee ene e eee eee eee eee eee eee see OHSS H ESE EE OEE SEE EESES SES ESESESEE SEES SEE EEESSESESHES EEE EE SEE EEE SE SEEHES EES SSHSEESEDESHESESESEHSSOEEEET SESE EEESSESEE SEEDS EEE ESESEEEEEEH EHH EEEHEEEE EES une 
LEI COO eee OO Heer eee eee eee ee OOOH TEE HEH HEE OE OSE SESE HEEESEDHO OHHH EO EHESED EEE HES OSHS OSES HEEOEOHE OES nuevos omMey| pue ‘OIZ Iq OoIeIY ‘OIZVIO..q O][O0IeP\I 


SJUTB.ISUOD [PISO] Suls~-) pue Ajureyoouy) Surdeydsiq  :vyeq [eoLOsaye_ JO} Sue [LONSNRIS 


eT I Cee eee cree ee eee ee eee ee eee ee seers eee sees eee eee ee EEE SEES HEHEHE SE EEEEEEEE ESSE DOES SEEDED ES ESES SEES ES OSEUEESESOE SOS ES ETDS OE EOS SESE EEO OHSE SESE EEE ESET ORES BIOQUIOM PET Jolueq 
SADAING PJOYSSNOH{ Ul SUIAQ-]JaA\ SdINSeaT] SAIVIS Pou 94} MOH 


L6 Pee eee e een en sneer eeeen seer eee sess sees er ees ee eeeeees eee eeseeeseresEseseeseee Aagyend) W anjezng pue ‘oppoog ‘'D jorueqg ‘AYR DI Agyurys rer 
Loaneiodoog ssaq Ay], OV 
‘QIOJ WT, OyIOg 9A J] ‘osuodsaIUON pure usping Asvms usoMjog diysuonyeay oy} Jo sisATeuy UY 


18 eee ee reer ee eee eee ee eee e eee eee eee eee eee eee ee ee eee eee eee ee ee eee eee Tee Teer ee ee eee errr eee reer errr ee cer r errr errr errr creer sy sloquieyy Key pue uduOSyerT] oddas 
dn-moy]oJ YIM osuodsaiuON SAyeULIOJU] Jopus UoHeUIsY AdAINS 


IL Perro eee eee eee eee reece eee eee reer eee eee rere re eee eee eee errr ere reece reer errr cree eee eee rere ere eee eee reer rere r ee eee eee rrr) yered youap7 pue no[sompty V Jevyory 
ADAING Opell [lejoy URIpeuRD oy} 0} UONeoTddy uy :uoneUNsY onry suryey 


ES meee reser e ener ere rere eee sese reese ee screseeseseeressenes Sue A utfong pue ‘Uo dg yep ‘Ppleuogoy aN uyor U0WWs JOAOIT, ‘Ul[POH ueqg 
skejoq sunjodoy 0} onq sues Suldures ev Jo oseJOAOoJOpuy) oy} SUNeUISA 


5 ere eee eee eee eee eee eee eee ee eee eee ee eee eee eee eee Tee ee eee eee eee eee ee ee eee eee eee eee ee ee eee eee eee eee eee ee eee eee eee ee eee ee ee eee uevurezznbyes PIN pue Koy ysoqoq 
usIsoq] AdAING xXo[duIOD sseyg-oM |, JOpu_ poypy aruppypoer Aq UOneUIYSY soURLIeA 


I Pee e cree eee renee reese eee eee eee eee s sree ser EE see EEE DES E EEE TEESE OSES ESSER OSES ESTEE SET OSEE TESTES ESO ET HEED ESOS EE SSS EE EEE EED une Wa preuog pue Agyputy “J praeq 
SOLID OWT], YSUIT-sye.IOpO/| 
pue YWoOYs oj sioqLy JuoUsnipYy yeuosess VWITAV-ZI/LI-X pue SLVAS Jo soskjeuy urewiog Aouonbe1y 


9007 “T “ON ‘ZZ OUINJOA 
s}u9}U07Z 


“‘pleog [BLOVpP_ UY} JO SIOQUIDU puK SddJOJoI JUopuddapul Aq PAMdIAdI A[SNOJOSL oie 
s}duosnuew [TV ‘poziseydurs ose suoneziuesio [eonsHye}s JoyjJO pue sod1Jjo [eUOeU ye SoI}sNe}s JO UONONpod ay} 0} yUoUTLIOd 
sonssi Joyjo pue Asojopoyjow Asaing ‘suoneordde pure ASojopoyjow JeonsyR}s ul soziypetseds yeu AjJoyenb Ayrepoyos & SI SOL 

UIPIMS SINsHLjig Aq poysyqnd MIAIY [VUOHeUAIIUT UW 
SOTLSILV.LS TVIOIHO AO TWNANOF 


—— a! & 
Rea i 


Berend yon yn .eun ps paseeh yypysoem ute 
SPosusceaig® Zeaureiying Cawege 


; £4 Cages, auttese yore uae OY y Zajcae yay 

RU 

0G eb cys Qiicin Gh TREN Hoey ozo. ce 

Be penis’ (eosin, GL Does goyation ies 

SU Cu eA AAD SL Coy homens: a Eyer 

GP [MATEO PTONS 74 \) \aser.rey jon, 

Bot Son" Seti Cush (yas 

PIGNIEe Pimyetiane, Ce dey 

; G Spirp “ycenan yen (genres GL ganna 
latipaay Warne, Cowes. terns 

Recap’ Tyynss.2tih. oh L.yourers 

Darang! penises Cougs 

PpwY AK Ae CoMann 

aR MOOK) TURE Z! 

Eppa0ns yersmey spisubis prune ~ 

Roget. YeVscaiAs [Lys (retin 

SICTIEL” CAG, FOIA MSE 6) Teens. Qeereayee 

¥ Orr Tera). OL ay yoo 

Bos CMSA, LOOM eo (oY 

i rane Pewty ont 8 ASIA aa YS? FAIA 
PROCES WAL. 

PP MRICA’ TOM MIGIM Cunneiaith’ Callao 

PICU GLUE CUTTY OG PLO LH 

iit’ OMLMAaIh 0) Cam Std 

Be poeypand’ pera yw | 

mit bbc. prey" SPRLARLANL LC), AAT OL DRCRTAL 

nist yet Pores CMe.) 

Bec CSN, SPO 9), QAcity ese? Grace, 

ROUT WARE CO (Cems OL Fp yacawayn 

BeBe” his Cptyeaatin 0) eons? 60 

FP ReenOul Asliynine Coun 


grist fee TOO 


tt 


n > 
: . 
2 
) . 

— 

> . 

7 ' 
, “" 
: ? 


B DINOS qe2 eapoure ep attdnignse ipbage qea aigosiscs* bom jon abhor 9 Jo CODLIIERUAN ju CpIGLA;! ELeNG Ob PE LEQUEL ist 
eupehiyate, * pAUszouncns, none Qgaiced axbilvc pons iecoULINietcS ¢ CotLiAnTe Corman Cabs PLE St Daur Toone 
oie Bova (LuesetOU yee yrubriee opciones sc partypesoa) of pobpte Cymura (Pianos qua meroqed g sudngiee Bibi 
ipsa paquie Paco (Diteod qee zeLAe ¥ PF Cl aneiR)’ Ppete Bey (Die OB qpAcpolbcaucny aye edargr4) 
pres Dyaurcka” yune-\ynic L fam Wopeuo Ge” Pre PRvOM yyroper Lem et Tespoye poydom (Hwan Ys J 
on ametopare (spect cenx din ont comming % pa biequiemen qae orwade ge 1e seate bee, sone Cerne omuin 


CUNARD OL eam hrisys 
{ Sewnyo' LYSOL, OL DURA LYS gE CtLW ots BLMOOF 
ry we avi caneegs 
C AAT Cee), OL SO 
WV Ave esi 
Sh AAPOR Paster, (reas, QetAcNaY ASH 
ASTM Tyo ee OL Py be 
Choy SER opi (oes Cena 
- Sune Wan \ Weeder you? WY (aOR nt 
C Gyula” Pysicens GL poieye tan 
eo pale’ (7 Cine pa 
f POOR (eso 2ih 9) aCe | 
l At ed oe {tebe Gi AAT Tio Ws ad ‘ad! 
(F Banr’ renee he 
ols eae CaIrSveNg TING 
Ak” yee’ Cees Ceres ats 
YEG a viit 4 et oe wi : aE As 7" ty i) \ Cisttval 
PP Gomi” cana ae yay Parte 
tA’ RLPeUT Cueheeth Oh vines 
Fy baleen’ yg a9 AprAcatt A. gery 
Rh) Ss 
9 OLSOREs joer Que Cpa 
ce TOGA (eet OH, tp GR 
Tey Pred’ yew ye 
TX VESiO™ TN oie Geert OL tp Cowen 
¥ ypatei* a a sha AKIEY “GE ES 
ne OTA Pabeagainaay GE Yyayyee hese firs Dare 
.. Peno Qtek Coot 
Fr Cepmoved’ (aymad oO yey 
re WER 
Wd) Cas CO WU 
AD [RIG one Gee Tea 


byuivie ig, curtngne quris Lasimtcsct poe boiatumes any jauice’ dim ay [oman ge Ler Onn Grit PR CLiRASOR 7, NaF MANETS 98 


UOTIOLPal BT 19 oTydeIZOTA}OEp eV] “UOTeUIPIOOD e] eB Wodde Inoy Inod ‘sasdeusul sep soidne sajgnbus .p sopoyjeul Sop UOISIAIC] &] Op 
QITWIIT STUD] 19 JOIIYY OUT[IID “NeoUIsnoD sUT|STIYD ke SOURSSTRUUOSEI 9.NOU JOWNIdXS SUOIISSp SnoU JUSWUATeUT “(sastidanua sop 
soidne sajonbua .p sopoyjeul Sap UOISTAI) JomseyD otydos jo (UONONpeN 49 So][SIOYJO Ssonsue] sop UOISIAIG) UIpNesg stosuely 
‘(sougysks op juowioddojaasp np uoIsIAIq) Yong Woy “(a[QJUSI[D eB] B SSOIAIOS Sop UOISIAIC) xlOIOeT oUIpeN “(UOTSNyIp 
B] OP UOISIAIG) uUINbIOg s]JOqQes] 30 JeYD[Og [ROYydIP ‘oloueT sue] ‘opiny oyogoy ‘Amo sliepj-ouuy ‘slowed sstnoT 
‘onbinog 2]1999 :900Z Inod onal ke] ap soJoUINU sop UOTONpold ev] e sNqLNUOD JUO INnb xNn9d JWOUWs[es9 SUOIOIOUIOI SNON 


piupapAsuuad fo Ap1ssaaluQ 

“TOOYIS UOJADY YY AY, ‘SOUSDIG fo Juaujsvdag ‘oynueZ “Fy 
ppouvy anbiysipjs “SunX “A 

oopsajoy fO ApisdaaluQ NA “OD 

JoISay ‘do[BUIM “We 

OOJAAIOY ‘AJISABAIUL] AALANDT plAfjiy “BUEN “7 
ubpsiyrpy fo Aissaaluy) “ueriypeA “yY 

AJISAIAIUL) AASDAL UOUIS “ZTEMS “f'D 

Duy yasvasay Aoyjog vayowuaylopyy Vrenys “Fy 
uojdupyjnog fo Apisdaaiuy) ‘IOUULIS “DO 

nvaang snsuay ‘§'fQ “Yysuls “Yy 

puvjyonyp fo Apisaaaiuy “ys “VW 

AJISABAIUL) AJDIG D1IuDA]ASUuUag “IoyeyoS ‘f 
aday-aasuy ‘KIOyNeS ‘OC 

[DADT ayISAaaluy) “SOATY “d-"T 

AJISAaAluy) UOJAJADD ‘ORY WNL 

pIsndad Ip IpNIS 1sap ,Dj1Ssaaiuy) “TTjRURY “DW 
aSSINS ‘JaIpYONaN ap eyisdaaluy) “Syend) “T 
pjAaqg Pp fo (isdaaluy) ‘peselg ‘N 

uojdupyjnosg fo 4isdaaluy) Pud JavAST “UUEUIOJJOFg “G 
ppouvn,) anbysijojs yeyed “7 

AJISABAlU.) ajDJG DMoT ‘1oWIOSdQO ‘f 

uasuigny fo 4pisdaaluy “yoruuny, “yxy 

‘Quy ‘Joisay “epInbeyuoypy “Wf 

snsuay ay) fo noasng sajvj1g pajiuyQ) ‘d2]2W 'd 
ISSING ‘JaIDYINAN AP IJISAVAIUL] “Taye “V 
SOYSYDIS pup soyouUayoP fo Juoujsvdaq “NT “N\A 
ppouvn,y anbijsyoj¢ “uorT ‘dD 

1yUuIsjay] fo Ayisdaaiuyz) “usu0,YyaT “Y 

‘Ou ‘JoIsSay “99TH 

ppoun,y anbijsyojy “aa{[eae’T 

AJISAIAIUL) 2JDIS DMO] “UdSIe'T ‘C'W 


Asojopoyjayy Aaadng U1 WDABOAT JU10L “II NITY “J 
ppouvn,y anbijsypjs ‘QIAdQeaoy ‘We 

JANJJNIABY {0 JuaujAodaq sajvjg pajluyQ “Worl ‘d 
SIIMOUOIT 

JIANOSAY PUD adANyNIAsB yp fo ndaiéng Uuv1jDAISNY “NJOY *d 
pasoy ‘sausyojg payddy fo juaujspdaq “wry YI-'f 
Slang jo piusofypy fo Aissaauy “suelr ‘¢ 
[DUO1JOUAQIUT [YY “QUOTYDOVUUR] “HA 

Ajisdaaluyy 41d urjgnq “uesioy ‘f 

ppouv, anbysijojgs “ezizey ‘ 

SIISYDIS {O NBAANG UDIIDAISNY “SUWJUD “OD 
AINJYSUT AVIUDZD [DUOIIDNY “preqnesly “g 

pplsop fq fo Ap1ssaaluyy “YSOD “WI 

ppouny anbysyojg “pres “Od 

pppun,y anbiysyojs ‘ourquied *f 

AJISAIAIU) WJOYYIOIS “Yue ‘O 

IINJSUT AJBUDIAT YOADASAY “WOS|OT “Y 

IINJYSUT AJBUVIAT, YOADASAY “IapIy “We 

SINSYDIS AOGQVT fo nbaing sajojg payluy ‘osun{q” ‘f 
upsiyrpy fo Missaauy “Worl” We 

YN ‘uojdupyjnog fo Apissaaiug ‘ajnjijsuy 
YIADISIY SADUALIF [VIYSYDIS uojdupyjnos “‘uelng ‘g_’D 
AASNI ‘wodng “4 

OsDIIYD “Aj1sdaaluy:) UbIIUIWOG “UeDUNG “YF 
[padUOpy ap ajisdéaaluy) ‘ousoyonq *g 

p1IBsoay fo Misuaauy “eyed “DH 

‘Quy Jojsayy ‘KINYPMOYD “YA'S 

soysyojg fo noaang uvypasny “pjaysoddryy ‘f 
AJISABAIUL] UOJSNOY uvg “reyng ‘J 

J2DAST ‘SYsIIDIG JO nvaANg JoAjuaD “yoIng “T 
UISUOISLY fO aBa]JOD JoIIpayy “nesIpnog “dD 

YN ‘suipvay fo Aisaaaiuy ay ‘Ia819g ‘X 
ppouny anbysiojg ‘yuoumnesg *4-"f 


‘O007 99UUeR .| JUeINp snjd 


no sponse un.p onbyLo ke] Wey JUO No opre.| op rumMo}j yuo Inb ‘sayuKAIns souUOsIod So] JOIOIOWIOI oIsap ajanbua p sanbiuysay 


SINGING NaN 


6S2 


. P acon an arin ena “a ms 
ee i a a 
9 vaio uae “munis (Seat) 4 elig ory, Sn 


’ aha er een toe hathiesing he vi yi 
a Tha Lee i » ee , a Tp - "Mia CT? AB) 

_ ey 7 ; : , ; fit P') Le hos ; 

Peery jue waees ‘3 


- ; Vaid» 4 pit cry ft " om nest | ar | 
: vim : 
ms 0 


yy ea ON 
ws 
iv poe om o0 A 


xs hs Ph py cant eli) 


Lie ; 


tae (ya 
il 


iV pS 


healt eae 


Piet re eine PW ele | 
pad ay ayt a yaine = -? pal} “ond 


Py” wien oy” aN 


: yf ; if ' le v 

‘a - 
ee 
ac 
7 Sn are: i iy sees! - rt pre: an fl un fth ; 
lA 


eaget sy a 
ti i eowinhiy 
, 


' 
: : at pty, 
s ys ce , Wea 
_ 


“3 


tat LORY gat; \eevad 


hy iT rT Uk! hee « 


- | 
~~ 

of Hi a} _ Val! ‘ 
A ’ hie 1 Ww vailie 


LAG ; 
Pe erin 
79 


hacia Al ks Md if 
* o Eel i] (ide | } +f EF i é ¥ be ‘ 
, ' ; 


0 a es jaa 
u porta ini 

ey vane ty Ne KM: 
ie Paws Hal ye arnt 


WRAY Say ny Us 
ro eo wa? of Ah me 


enti af) i 
ig Ta AS Sean is j my 


Ty Sie EN Sha NP nia hx gD 
? any Gk y Pe) iene arty b Wetien 


ue. ny y ait Bye ltt 


ae 


Fy np iol sal a dee ua 

ve at won. a TOA 1 ‘ 

> BODLEDY 5 \oriisien, Oh Nya ELISE TATION Ie Ae’ 
_—_ Fat el got wiulne ay “y ape ip iter isis 

pe o el Uke taibeinacs (ct tetany 


wa 


7 ate Fee eee TM ce | 
| weeny (JOaREas a Lye ani ogaRAr ayy q'5 SRE, “LN she 


L ie a4 a el ee ae pe cn pn Ge ie 


S Fil Re i m iy wee 
ay ae ot Oo eS) aol 19 


wy ahha 


“ ae MK steuoy ih Vad GALORE A 
tal Lihat gag on 
a i mers (its a We fo Wyre ureaput > we ) Art, ye 


POT Ha'aR SUL erate 


wh 


40 »,) ey Cary bat) 


mt *) y : coke re f 7 . 
Ameo AY? a) hry 
; ea me 


aaah fh Samay fro mr AOR 


> 77 gud} . 


' | pala Re ‘ithaca 


pa weaior “rr mage; ung iene, natn 1 


reer 1h en a ore 


pie é ‘ 4 - 
7a 
Lamy pa Sey papa, wate Bieta op i? 
ar RS) as Ae upped? » GTi oat 2 Sp whe pai 
dos ot SROs CGR esas bat 4 
mia r 4 Yew) byafea) {i war? erantl mae Pinu vile 
wrnanp Goi pie Ss q uns P| Ts. ey er 4 | »* #1 
va re ' ‘ 
Se eu a a 
4% hav "~G wee Arr niwll (ma ha eh mya vey J ’ 
pt uy BO 
a ’ | mow awit ne af! cal} a, iy v) Tr 
ee AL ty Sl he *) eer ss 
: “Wir ASW i os it pie we rity ; | } 
Pty aneyron! te ie ¥ eA Aa , tA Se , F 
Lome ; — ' 
ap feat Ur | reco, fe afl ” 
RAK Teel q Oe WE om ft 
j _— win’ 
waren it baht Ox. 
i i 
X Hi 4 
wee “Dy rent ( f 
an § er Aa } J 
Ory At 7 a i Mi pe 4 / 
F A 5) i Dp vo Hs it i i je 
wt ee UR TC rige ’ 
oi Fs j fh ‘ 
#y ne ' 
ett oe vi } ss 
; atl i ig , 1 i a 
ial aL 4 Daal j 
t b) ‘ ‘ 
iV Bs / 
j = y 
: a : 
i % i ; yy 
tnt eet ; ‘ ; 
i ] 
n) ti 
i ie ‘ ¥ oY 4 
Mat) Qe, Hel 
‘ 
fy" J ee 
(co. \j 
ie ¥ 
ae a Ne 7 aN ty ae 
a ata. P tad ™ * poss ro a | Fine SUN kL) 
AR PMA POSER G CRE SM Tate NT, ger . 
SRE TAA (aad Wah EG TS gO 
Hittieie Bee ae ite’ § ' on 
yt ele ere I 
TARO RE GRE! Apatite tin Payal 
er iy a . ALVe . Wy PA ee Vi 
on Pa A ft “ ty yi} the | A " ; 
Anew eos Ol Thaler sy sgt ye ne" 
aE ay PY OM 1 NC Pro 
cMitS feet f a) 4 a he f a) , f 
wile ark PRON 4 ie ces 
wee; 


ar ayn DRA ghee? Ke am » Ko a es ae 
basins er era sy RAY, ge mtgdag pa ifs 
pn i ohne yu |" 


ei. GPO 


veyatagie Sie y ape [> = am 4 

«era Bop eM PPG eanlyy (7) 
L : | eel vt wo ak MD Fey at ge 

i vial Lamhe ore ORAS ha J 


keh ge rly 


e eh De, 


“es, '} 


yee Pir 


Bars) 


i — 7 
ry a ae wat 


angojejeo ne GqX-[00-ZI .N ‘epeueD onbnsneis 


‘SCY-9LP 76 “UONDIDOSSY 
[POYSYDIG ubrIdaUp ay) fo JoUuANor “sSoIBOIg euoyeonpy 
JO JUSLUSSassY [PUOTeN ou} Wo sofdurexg :sjley yUdye] poyejaoo 
Joy Surdures xujeur yoy (L661) ‘N ‘Ssewoy yo “PT “IasoZ 


‘BR[IOA-Josuuds : yO X 
MON “UONDWISY aoUuDIADA OJ UOIJONPOAUT *(S861) ‘WY I3OM 


‘6V9-€79 “ET ‘AUloIpayy Ul SIUSHDIS 
‘(UOISSNOSIP S9AR) SOIPNyS [ONUOS-ased JO} USISAp oieUUOTsoNb 


jensed ou “(p661) “HW ‘THD 19 °C “ed “La TOueD “s “epjoyor 
“66E-EPE “pl “Juawmasnsvayy 
jouoywonpy fo pousnor “‘Surdures xuyeu Joy Arooy} poyessoqur 
wy ‘surdwes sousprlouy (L161) Y “UouTTJoM 10 “WY rUOMS 
‘Josulyeg : VW ‘ospuquiey “suijduny 
xo fo saanpad0i1g pup sajdiouiug (€L61) ‘W'd “exewooys 
“LOV-L6E 
‘LIT ‘stdoday yyppazy a1gng “sowoy Suisinu pue spoyasnoy jo 
sAOAINs Y[BoY [BUOTFeU WO sayeuNtysa souajeAaid Sursn Apnys osevo 
Vv :sAoamns Areyuowajdwos woy soyeumnse Sururquiod (Z00Z) 
WI “nzrys yo “gq “Surly “q ‘asoy “yf “URWATUED “N “axUaYOS 


LGC 


‘pSI-Prl °S6 “UoNDIoOSsy 
JOOSYOIS § ubdidaup ays fo poudnor ‘sues yeuonIpuCS 


poindumt yim soualayuy (0007) “N “Jeyuoyog 39 “TP “JayeYOS 


"pLE-99€ 
‘18 ‘UOYWIIOSSP JDIYSYDIJG ubI4aUp ay) fo JoUANOr ‘“asuodseaTUOU 
gjqeioust YM sojdwes wopuel sdwis woy uonjeunso 
[BAIT Joy UoeIndut efdniny (9861) ‘N “OYUOYS 10 “E'd “UIqny 


68t-ELh ‘16 ‘UOUDIDOSSH [DINSIDIG UDILIAUUY AYL 
fo jousnor ‘sreok +g] Joye uoneindun spdnin (9661) ‘a’ “wqny 


‘OUT “SUOS 2p AZTIAA UYOL : YIOX MON 
‘sdaaang ul asuodsasuon sof uoynjnduy adyjiny (L861) ‘aq “wany 


‘T6S-18S “€9 ‘vylyjawmolg 
‘(UOISSNOSIP SOAR) vJep SUISSTUI puke soUDIAJUT (9/61) “A'd “UIqny 


‘COL 

-16 ‘LZ ‘ajanbua p sanbiuysa I, ‘WOIssais91 ap sajapour ap souanbes 

oun.p opie, eB soyuenbuew smojea sop sidyynu uoyeyndut,.p 

g]JouUOIsusUIpHynu §=onbruysa} sus, “([00Z) ‘d “IadrJaquajos 
0 ff YAmooH URA “Wr ‘Tysmoydey “ql ‘ueYyjeunysey 

‘OVS 

‘06 ‘UONDIIOSSP JDINSYDIG UBDILIAUP ayy {oO joudAnor “UBISep Adams 
emeuuoysonb yWYds W (S661) “AL OZZUD oe “Ay “‘ueweunysey 


900Z aiqwesep ‘ajeanbus,p senbiuyoe | 


‘$70°66/ZDA/Dd 
yoddey ‘WyeoRY pue uonuaAcdg ONL ‘uoploy ‘Aoams 
S6-OAV 24} JO suonenbs poureys Aq uoneyndun spdyynur s,qQrxopq 


(6661) ‘f£ ‘TastoAoyofry ueA 30 “S§ ‘UoINNg UeA “Yy “WooYspnC 
“S8t-O8r ‘UOTRIDOSsy [eoNsNe}S UROLIOWY “Uo1Iag 


spoyja Yyodpasay AIAANG AY] SBUIPAIIOAT “SUSUID (ONT IeOA 
oy} Joy susisop Surjdures xupepy (€661) “Y “UYJUD 10 “Vv ‘ouraen 


"ELS-BES “6 ‘AQUAIIG [DIISYDIG ‘(UOISsNSIp daAv) Jndul Jo saornos 
JetussuooUN YIM ssousJoFUI UOHenduN sfdy NW (661) “IX “Sus 


‘]]eH UeudeyD : uopuo7T “uonips oworxneqg 
‘SJapoN ADAUIT pazypsaUay (6861) ‘f “OPIPN 1° “d “YseT[NW 
ITZI-ZII UoneDossy Jeonsneig 
urolowy ‘Uuolj2ag spoyjayy Yyoswasay Aaaang ay) ssu1ypaad0dg 
‘uoneindun ojdyjnur =pue uonexejol oseysojg = :sooueUuly 
JOUINSUOD Jo ABAING G86] OY} JO UoNeIndwy (1661) “AV Tpwusy 
“6ISI-661I ‘ST aUulolpayy U1 SO1JSIJDIG “eLUYASE JOSUO J[Npe 0} 


suoneolddy :uonoey o[qeinguyje pue ‘asuodsazuou smeuuonsonb 
‘susIsop osreuuonsonb yenieg (9007) ‘qd “UOT 10 “Aq “UeWAsnNOH 


‘OUT ‘SUOS 2p AZTIAA UYOL : YIOX MON 
UOHIPS oWISIOI], “~sanbiuyoel suyduwy (L161) “O'A\ “UeIPOD 


“601-S6 “LI “SouSiIOIS 
jouoyvonpy JO ppousnor ‘ssaiwolg yeuoneonpy Jo JUoUIssossy 


jeUOHeN oy} JO MIIAIAQ (7661) “U WIMZ “VW ‘uoyog 


ary deasonqrg 


UONUDADIY 
pue JONUOD sseasiq] JOJ SIQUdD sop soNsHRIS YYeoH JOF 
Jgyuad [eUONeN np suorutdo soy yuous010y sed yuwUasoidal 
dU 19 Sone sop xNdo Jos oJoIe JUaSeId 9] suep soquOsoid 
SUOISNJOUOD S23] 39 S}eINSAI SAT ‘San splasuos sos od SHON 
np unma Apuey yUoOJOWIDI smMayne sa] ‘OUT “YoIvasay 
SOLnoueyeq 39 SHON 2 Jed njouoo sjauuorssayoid saorAtos 
ap yequoo un Jed onsed usa soouvuly 939 JUO UeYjeUNYSeY 
“YF O1OOAU, + op 30 SeWOUL PON op xneaen soy 


SJUIUWIDI AI WI YY 


“SO[QULIeA Sd] IUD SUOTIEIOOSS Sa] JO}I0[d x9 
® JUOSIA Inb ‘oyonse Juasoid a] Suep ddIOQRIP dT]90 aonb saqjO} 
‘sopoyjour sop yuenbrydde us sagsiyeel a9 JUaTeLMod salqis 
-UdS SUOTNLIOI[IUIL SP 19 SIDURISUODIIO SdT]o} 9p Suep soonb 
-jdde velop juos yJoromneu oseuUOT[WURYDS.p some}USUUIpNI 
SOULIOF SOUTRLIAD “Ssdud} Sp 39 S}NOD Sp sazUTeUOD ap osneo 
Re ojonbuo | e sjuepuodeal sap sojquiosud-snos op soidne 
SOINSOU SOUTRLIOO I[[IONdII op sTQuITeYNOs jsd ]I NO 49 “(SddT] 
JUSUTDJIONS soyyuenb ap no) soyWUenb sowrgul sap soydyinu 
SOIMSOU SOP Soe} JUOS NO sUOTeNyIS sop SURP SadSITIN oO 
yusAnod [oIOLneU sseuUOTTHULYSE ._p sonbruyse} say ‘a~duioxo 
Jeg ‘Jelorneu oseuuoyNueyss,| e& syepipueo smor]Ioul 
ap jUOS soyuepusdepiayuI suolsonb op « sjoued» saqT 


andojeyeo ne dX-100-Z] oN “epeueyD onbusyerg 


‘S[Qpour 
un Ins s9puo} UOTRINdUIT,| e UdTG sUTOW yUd}9Id 9s saT[a.nb 
9}J0S op ‘UOT[WURYSS puvIs Ud UONRUTxXOIdde sop ims yuoInd 
-de,s mb sajuvmos sonbysyejs sapoyjour sasnaiquiou op 
SB 9] SUP SaINOYJIp sop Josod Issne yusAnod sores syUdU 
-OU9A9 Sop JURUdSaIddI SoTQVLIVA sa] ‘soguUOTTHURYOS suo} 
-sonb soy Inod sayeprpues souuog ap sed judre}9 U solqeLieA 
Soo JUOWOANDOdsSONSI ‘amoyeJoge] op pJepuRys somsoul 
SQ] 19 SJURINOD QJURS Op SoUaTqoid say red soyposd ustq sed 
yuos ou Inb solel sorpeyeur sop e JUoTepuodsaoo sasuUOTIN 
-uvyos suonsonb op oiquiou puis up ‘sojqeliea sone p 
Jed soytpoid ong e no ompoid e ayoedeo may op oydu09 
J1u3} don sues ‘ayues ev] op soqueyodun sonbysuajovses op 
oumlues oun JoyUosoIdol op ona Ud yUOUATedIOULId soIsIoYyo 
919 JUO suoysonb sal ‘“SANVHN 28 op eduioxa | sueq 

‘ques PB] INS sJonbud ouN ,p 9}X9}U0D do] SUP SosTUTO 
suoysonb say ms UOTyeWOFUT,] op yURVIoduut snjd dnooneaq 
JUSUSIANOSII UN,p dAnoid ve] QUUOpP yUOWATeSO yO (S661) 
JIZZIID 39 UeYeUNYSeY "j1e.) SUIOU 9] JoINsou mod sonduos 
suonsonb sap & Sdd[aLI0D JUSUMO}IOF JUdTe}D sogUUOTTHURYDE 
suoysonb say onb dosed ‘sjeynsor smoaypiour yuouUIa}oU 
op duUOP & (766 YOIMZ 19 UOyeog ‘ojdutoxa Jed) samejoos 
stnboe soy ins sjonbud oun ke joloIneU oseuUOTNULYDA | 
op uonroydde oun ‘ojduioxs seg ‘omeuuonsonb un suep 
soguUOT[HULYdS SUOT}soNb sop sindjoIpeid suOg op IdISQUI.P 
JURLIOCGUIT }Sd [I USIGUIOD INIOSSOI pe] ‘oIOLNeU oseUUOTIY 
-uevyod | op suoneorjdde sane soy suep snuajqo smeayouroid 
snd sjeyNsor soy OoAv UONOIPe.UOD Ud jsd INb ‘UOTR}e}SUOD 
o1199 ‘(JaPLAeuU ssvUUOT]HULYS suUvS SIIP B S99) BuO] snyd 
o]durod omeuuoysonb un.p usdoul ne snuojqgo yeme uo] 
onb sensei xne USWA neIedUUOD UOISIOSId op oylod opueis 
oun juoWOTeIOUNDS jeuUlenUS jOIOLNeW oseuUOTNULYDE | 
‘SdNVHN B®] Ms gpuoy o[duioxo., suep ‘“uepusday 

"UOISSOIBOI OP SOSATeUL SAP 91X9]U0D 
3] suep JUOpIAd yuoWDIaT[NONIJed ysd gOKONJa,.p ules 
oY] ‘UoHendul sues Yuowonbrun sporowyeur suoT[WURYoE sop 
juvudsAolid saguUOp soap asAjeuR | op o]Jo0 onb opuvis snjd 
‘MIDVOYJO,| 9 SOIMSUTU JUR}D sTeIg Op SoAnoid say ‘saovoTJO 
JUDUIDIOPOU JUSIL}ID S[OIOLNLUI SUOTTWURYDS sop JULUdAOId 
ssouuop sop sidnjnur uoneyndumt,p souasoid ua sasdy[eue 
So] “SUNVHN 8] op soouuop say ms yuvyiod apnyd,| sueq 

‘soquuop 
sop saysAyeue sop juonbasqns nvopsey do] JUSUIOATSSOOXO 
Jojuousne sues tu ‘osuodal op neapsey od] OIOIN0e sues 
‘gyonbus oun .p sajJod ey] ospusjo mod ‘oydyynur uonendurt | 
® sondnfuod ‘Jorolneur aseuUOT]HURYOS .p sud sap JasI[yN.p 
a{qissod jso [J] ‘AoAINg uONeUTWeXY UONLYNN pue Yeo 
jeuoneN ve] Ins Jueziod odwoxs un.p usAow ne seyUOUEp 
so ‘oyfoyoo opueis e ‘oxajduioo gues ej ms ajonbuo 
oun & o1Ua8 99 op sued op uoneordde | op sy]Iqesiey eT 
“sonjoxd 939 JUO Inb sajja0 ap saanorpeid yuos nb suonsonb 
sop jyueUd}UOD sameuUONsonb sap oimpoid op sjoudold 


jaloujyeu SHeuuUO||IJUeYOS,P SepoUujeW Sap UOHeN|eAs aU : UOSUYOL je HOzZ}eyY ‘’ayuasyos ‘ueuyeUNYHey ‘sewoulL 9GZ 


ansoyejeo ne GqX-100-ZI .N ‘epeueD onbysneis 


eB] JURAR [OLOLNeU dSeUUOT[HULYDE,p suR[d sap 19910 Op oNA 
Ud spoyjJoU ouN .p UOHeIOgRII,| JWOSp spore yuosoid a] 


UOISSnISIG. “fp 


‘epnyg,] Suep gsi[HN Inyo onb 
SQ[NUNIS SUOTTHURYOS,p oIquIOU puURIs snjd UN ms jURpUOy 
aS Ud SagTNoyed a.j9 yUdTeLMO d1DKVITJO,] OP 39 STeIg Np sasto 
-o1d snjd suoneuinyss soq 9°69] | & OI X 3°6 Op JUSTeLIRA 
UOISSOISII SP SJUSIOYJIOI C{] sop sajygjduloo saouUOp 
Is sInoyeurysd sop sgynumts sadAj-syreog soy ‘opduroxo 
Jeg ‘OSCUUOTOYIE,P SOOUdIOIJIP op osnvo kv ‘ayNe,]| B UITSO 
onoueied UN .p JUSWdLOJ JUSTIRLILA SUOTTHULYDS Sop sTquUUaS 
-ud J Ins sodAj-syies9 say Juepuaday ‘suoT[HURYD9 COI Sop 
a] quIdsUd | INS SoT[onprArpur soyyUenb sap sadA}j-syrte99 sap 
UOIIAUS SWIIIXIP ne soyedd JUOS opnjd qUasoid YI sULpP Sod] 
-NUIS SoUUdAOW sap Oped aJUOP ap sodAj-smMde soy] 
"UONL|NUIIS 
Jed opnyd a.OU suEp d9ST[NN YNZ [ Op 9][99 onb sapuess snjd 
JUSTUDTQISUDS JUTVIOS SaJQTduUIOD SaguUOP d9Av UOT] HULYI ,p 
soyie} soy ‘sojonbua sopueis op ke jolomneul osvuUoTN 
-ueydsd,| op suoryeordde sasnaiquiou op suep ‘aonb Joustjnos 
Op JUSIAUOD [J] ‘SUOT}ORIOJUI sop UONRUINSd | JUOTIEAeL 
Inb soqelivA op SUOSIeUTqUIOD soUTe}IN0 Inod uo] HURYD9 ,p 
ay]re oqnod ey eB onsed Us Op qeIg el) ‘sopqeisuT JUOTEIP 
sojqjdurod saguuOp INS sMd}eUsd suTeLIO ‘soTNUUIS SUOTIN 
-ueyds9 so] Inod 007 [ Op aIIe} sun ddAv Way “IN9}dIpsid 


ov 69 
I 
Cc 
v 
@ S 
Cc v 
g 0c 
8 67 
€ c 
v Vv 
L c 
3 (6 
© 
I 
c 
I 
I 
soo]q xnoq d07q UN 
souonbely 


onb JUL} Ud UONOVIOJUI.P SOI} Sop jUdTeUdIdUIOD soTopou 
sureyioo onb sored ‘/7 & 8 op JUSTeLIVA snoyoIpoid op o1quIOoU 
d] “€ NVI[GR} NV SOISUMNUD UOISSIIOI SP SOTOPOU sa] SUR] 
‘(OL & 9 op) nagad onb snjd nod un yea 
UOHLINUIIS op opNjd,| SUBP d07q Jed soJOTUJOp S30 op siquIOU 
3] ‘saquUOT]HUeYOS suoNsonb soureyad ayuda sonbisoj 
SUSI] SP 9OUd}STXO | onb Isule ‘TT SYUNVHN 2] suep sed stew 
‘TIL SAUNVHN 2 Suep soguUOT]HUReYyDS suoysonb op soud} 
-SIXd,| onb s[9} sowlgyqoid ap osnvo ke ‘ano ug ‘souNUOS 
suonsonb sap sUUIOd a]qIe} Soy} }Sd DOUDTeADId BI JUOP gues 
op soulafqoid sa] ms suolsonb so] Ja1JgpIsuOd ap oTessao9U 
ong weumod [I ‘sogyui] JOS UOT[WURYDE,p soq]Ie} soy 
NO suONeNIIS So] sURp ‘[eI9UNS U ‘SoUNUILUOS suOTsonb sap 
}IR} SUOAR Ud Jo SUOTJSONb xnap S30 op UOI}eUSISEp LI SIfIPOU 
SUOAR SnoU ‘someUTUT[oId sasessed sonbjonb soidy ‘sjuiaye 
yuate}a ud Inb sjafns ap sed yuoreuayu0d OU S9TNUIIS suOTIn 
-ueyod sop siquiou puvis un ‘oyInNsUOD sTUTy UONendod 
R] SuUBpP gJURS op sowe[goid xnop soo op soUsTeAgid s[qQIey 
R] Op osned Y ‘saquUOT[HURYDE SUOTsONb sUTUOD SogUSISEpP 
919 WO (TIOWH © WIOVH) sndny 9] 39 opno x ‘gues 
op soulgqoid xnop op jofns ne suoynsonb xnop “‘yedop ny 
‘OANO 
ud ost es juemp smnbor 939 yuo nb syuowjsn{e sap jo 
uonefnunts red opnd.] op soieyuourgtddns sayy soureyiso 
Op JWOWOASLIG SUOINDSIP snou ‘UOHOeS aUasgid eI Y 


uoneNUIIS 
Jed opnj9,[ ap sorejuomgddns sayy op"¢ 


[e}0L 
OG 
[9°T “p‘T) 
[pT ‘ZT) 
Le lealle) 
[Tt 60-0) 
[So‘T ‘T) 
[1 ‘S6‘0) 
[S60 ‘6°0) 
[60 80) 
[80 ‘L‘0) 
[L‘0 ‘9°0) 

[9‘0 ‘s‘0) 
[s‘0 ‘r‘0) 
[r‘0 ‘€'0) 
LEO ‘Z0) 
Alen 0) 
[T‘0 ‘O) 
solel Sop 9}949.I1N0 


SdO]G XNSP 9p NO d07q [Nas uN,p 
JULUDSAOId saguUO][HURYE So[qeIIeA Sop }Ud}10dWIOS 
UOISSIS9I Op SaTapour say onb uoTas ‘UOISsaISaI Op 
SJUSTOYJIOS ¢]] So] Inod ‘syuepuodsa.zios uoTyeyndurt .p 
souasoid Ud SINdyeUIT}Sd Sap xndo kB sojay]duI0d saguUOp 
Sd] IMS SINd}eUUISd sap sorNutIs sodAj-syIvd9 sap soney 
L neo[qe 


GSC 


900Z aiquwiso~ap ‘ajenbua.p sanbiuyoe | 


ondojeyeo ne GqX-100-ZI .N ‘epeued onbysyejs 


SII [e}0L 
I L‘¢ 
(I ‘9‘0] 
I (9'0 ‘r‘0] 
9 (r‘0 ‘Z'0] 
bb (70 ‘0) 
7S (0 ‘70 -) 
€ (70.407) 
4 [r‘0- ‘9.0-) 
Z [9‘0- ‘I -) 
I Lh 
I Sel = 
I OH Nec 
I ese 
souenbe1.y SOSIPIEPULIS STLIG Sop 9}j949INO 


UOISS9IS9I IP SJUITOYJI09 ¢ | | 
so] Inod a,dyynu uoneindut,p souesgid 
Ud SINDJVUINSS SOP S9[NUIIS S9sIpIepue}s sIeIg 


9 nvos[qe 
(DOAAddS 1° 
(Z)OAAddS 19 “(€)NWVAdddS ‘(DWadddS “(Z)(TaVH “EuvH) 
‘(Ee €UVH TUVH) ‘(PING dE ‘(€)NHLIYVNG 
‘(Z)AIOWH ‘(D)XASSH ‘(S)aIaOVSH AIOVH onbysiso7T °g 
[(XASSH) 9X98 9] 


uojes] (6 INAdNdxNHLaavWda 
19 ‘(OMIAOVSH«N Ad 


‘(Z) 1 YVH ‘eUvH) (NONIS 
‘(UNA dW ‘(1)asVvsH 0 La 
(¢)\(UVH “EYVH) ‘(E)NHLAYVWG “(Z) YI OVSH 0vZ=<dHO IS 1) dHOH anbiysiso7Tq */ 19 9 
[((CUVH ‘TYVH) 


guiny stewrel yueke uu souuosiod xne 
PHU] 19 “CXASSH) 9XeS 9] VOTO] 


(S)\EUVH (DINE dW 1° (7) Y8VsAH 
19 “(E)TUMVH ‘(DOAAddS ‘(€) NHLOYVWG ‘(Daa DVSH OAAddS aNegury *¢ 10 p 
(dID 19 


‘(D)dHO “(1)dad “(ddd “(1 €aVH 
‘(DICVH ‘(¢)NHLEYVNG 


(DdID 9 (€)das ‘(L)YISDVSH “(1)XASSH OIaVH onbiysis07T *¢ 
(DINE dN 
9 “(Lda “(e)NHLAUVNWG 

(¢)da ‘(L)MISDVSH “(1)XASSH OIAVH onbysiso7T *Z 


(1)dHD 19 “(€)NHLEYVNG 
(dD ‘(LUIFDVSH' (1)XASSH dID orlegury *] 
[QULIVA e] 
B SQTIOOSSE UOISSOIBOI OP SJUITIOYJ909 
op siquuou 9] onbiput sasoyjuored 


J]QelIeA vy] JURUA}UOD d1JUD OYJTYO oJ ‘oyqeizea 
90]q 9] enbipur sasoyjusred = onbeyd Inog ‘ouIsIIO | e 99UUOPIO .p 
d1JUD OYJTYO 9] ‘oyquisea dULIO} UN Issne pusidui09 
onbeyo nog ‘UOIssa1s91 a[apoul onbeyD “uoNde19jUT ,p 
op SoTepour so] suep SOULIO} Sop JUeNOUI sMayoIpeid UOISsoI3O1 
soguUO][HURYOS soTqulie A, Sop I99I0 Inod saepooal safquiie A, ayuepuodap o]qeiie A ap sjopowl op odA TL, 


UONENILAD,] SULP SESTIIIN UOISsoIZ9I op SoTapoy| 
g neoqe lL 


jalouyew SHeuuo|UeYDS,p SepoujEelW Sep UOHeENj|eAs BUN : UOSUYOL }e Hozjey ‘Iayuasyos ‘ueyJeUuNYBey ‘sewoul GZ 


angojeyvo ne GqX-[00-ZI ,N ‘epeued onbysneig 


‘sassnod 
snjd apme oun juoresayysnl syuarsyyooo sayne .p nod 9}10¥9 
-lJo.p sjuoredde sures say onb Isure ‘syUsIOJooo suey 
Inod sagasasqgo soja{durod soguUOp IMs sIMNs}eUIso xne JUSUT 
-oAlye]ol sdyynu uoneynduit.p souasoid us smoyeulnso sop 
gOvoyJe,p soyiod soyuryodumt so] ‘sulowURON ‘UOIssoISOI 
ap sowejgoid soy mod uoneyndut sues smojewnso soy 
anb saovorye snd yuswayeisues yuos sfdyynur uonendurt .p 
douasaid Ud SINDUII}SO Soy ‘OUD ‘SdSI[YN JOS sdoO[q xnop 
onbsIJO] SJUSIDYJO0S OF SOP pp Mod 9g ke SMOLIQJUI JOS STI 
39 naf ua ayua suoysenb ap s07q [Nes UN NbsiIo] s}udIOyJo09 
69 Sop 9 Inod Z ke SIMOLIOJUI JUOS ‘7 NeoTqQe) Ne soUNsaI 
SONI SOP SOLIWD SOP SOSIOAUT Soy OIIP-e-}S9,9 ‘ordnynu 
uonendul,p sousseid ua moyeurnss,] e@ yUOWOANeIeduUI0S 
soya{duuos saguUOp INs INd}eUSd | ap SoAydEdsoI sogTNUIS 
SOATLIOI SOLOVIYJO Soy ‘ONUOD Jeg “9 UOMAUD,P 4Sd SATLIOI 
anbuicey} ayoRoyjJe,] ‘soojq xnap op jueudAoid saguUO] 
-[HURYOS SdTQeLILA SOP JULUDJUOD UOTSSIISII SP SOTIPOUT Soy 
Inod ‘yaroneul UOT HULYDE | SUBpP SLIdUOS sjalns sap sNIOW 
RP] JuoWOAQeUTxoldde mod onb saqeitea sao ims sayoid 
-UW09 SaguUOp Sop B.IO}SIXO U [I.nb sored ‘7 ve ayeSo JUSWIOAN 
-eulrxoidde jso “Jorwuoid np aJ90 & pUOdaS Np SOULLILA P| 
op ONVI I] IIp-e-3S9 0 “UOHeNdUIT suUKS IMd}eUIT}SO | B JSUT 
-OATLIOI Soyg{durod sosuUOp IMs INd\eUISa,| op onbuosy} 
QovdYJO J ‘O0]q [nds un,p onb yueudAold au soguUOTTHURYDS 
SOTQULIVA Sop JURUDIGUIOD UOISSoISOI OP SOTOpOU Soy Nog 

"UIO] SHY SUOINDSIP Ud SNOU SUWOD “OLLIITXIS UN JUSWIOTNIS 
so soquenbueul §=soouUOp sues JOIOLQeW UOTTHURYO9 | 
suep sjofns op uonoey ey soyjonbsay mod ‘soojq xnop ap 
JULUDAOIA SAQUUOTMULYIS Sa[qeLIVA Sop JULUDIUOD UOISsoIs9I 
ap sojapoul sop mod sorrasgo JUOS sorqiey snjd soy sones 
xNop Sd] ‘o.JNO UY “UOISSAIS9I Bp Sd[QpOU sap IMs spuoj uON 
-eynduul .p snssoooid un .p juRyNsoI JorUJop 30 ‘uoKeyndunt Jed 
S$99}9[dUI0d saguUOp sdj IMs sa[spour sap yuoWa}snfe May[IOUWW 
un & 30 Soja{dWIO0d sagUUOp So] INS UOISSOISOI op soTopoul 
suleyioo op juowoysn{fe steaneul un e onsed ud snp ane 
yuoreunod 19-a]]90 eB sinowodns no gy1un,] op saysoid sonel 
SYJT (8 19 ¢ ‘Z ‘| SoTapowl sap ‘uaWANoadso1 ‘ueUdAOId) 
€‘0. B SINOLIDJUI JURID SONI say ‘JoIOLneU sseuUOTTHULYSS || 
RB onp ooRoTyo.p ajuepodu ood oun MoAe A o[quies TI 
sjonbsa] Mod UOIssoIs9I Sp SJUdIOYFO09 aenb a3s1Txo [I “UU” 
‘J UOMAUS.P 189 OVI J YUdIOYJo09 un mod jo ‘ajdnjnu 
uoneynduit p souasaid ua sinayeullyso sap xneo onb spuris 
snjd JUsWISISpoOU JOS saja[duI0d sagUUOp soy IMs simoyeU 
-IJso sop sgrnunts sadAj-syieo9 sat “(g 30 / ‘9 ‘E SaTapoU sap 
JURUDSAOId JUSWMdIOTTNOHIed) UOISSaIB9I OP SJUSIOIFEOS s.anais 
-njd mod ‘anno uq ‘(p neayqe}) souusAoU sap UOTeUISA | 
op sed 9] suep onb | op yuoysoidde.s sone ap uonsodoid 


€Sc 


oyoy snd sug (8 1 ¢ ‘“p ‘E SaQ=poUT) soo[q xnop op 
no (Z 30 9 ‘Z ‘J So[apour) d0]q [NIs UN,p JURUDAOId soguUOTIN 
-ULYOS SO[QVLIVA Sop JUSUUDNUOS UOISSOIS9I op sofgpoul 
so] onb uoyas saquasaid yuOS s}OUNSIP SOUUNSOI Sac] ‘UOISsaIsEI 
ap syUdIOyFood ¢{[]{ soy mod ‘ojdyynu uonemnduw1,p soues 
-o1d Ud SUOTLUINSS Sop xNdd B SI[NUIS sdgUUOpP op soTquUas 
-Ud QO] Say IMs sayg[duioo saguUOp say] ddAR SUONRUITSO 
sop soadAj-syivo9 sop sonel soy oumsor / negqe}) 97] 
‘yuowaTnas ydas inod 9‘¢ v samoatiodns no sayes9 39 
‘xno aqua p burs mod onb | e samatiodns yurj9 U sonjosqe 
SINICA So] ‘So[qIe} JOS sTeIq sao op yednyd eT ‘UOIssoIsOI 
OP SJUSIOJI09 ST] Soy od sasiprepur}js steiq soy SUINSI 9 
negjqe} I] “['¢'¢€ UoNdes v] e sUUDAOU onbeYyo mod sgsT{WN 
a]Joo & onsojeuR s[NUIIS 9SIPJepuR}S sIeIq np UOTITUTZOpP 
oun suojdope snou ‘UOISsaId9I Op JUdTIOYJI09 onbeys mog 
WOTINIS dJUASOId VY B SOVOTTFO Mg] B SJYR[OI sonbuosyy 
S}BYNSOI SUTeLIOD Op sUOINdSIP snou sIeul ‘UOHR[NUIs Jed 
opmd,] Sup snjoUT 939 sed yUO U UOISSOIS9I OP SJUSIOYJI09 
so] mod uonvndult sues smMoyeUIso sa] “SJUSIOYJOOS CIT 
{no} ua 4uaTeyduOS ‘¢ NeaTqe} Ne seisuINUS yUOS Inb ‘UOTS 
-SOIS9I OP SI[QPOU ST “oINjVIOI] LI SURP S}LIOOp so[apour 
XN SOIIL]IVUIS JUSIOS sTt.Nb a10s ap soy1oads suoav snou onb 
UOISSOISSI SP SOTIPOW! jINY Ip SJUdIOYJI09 sop UOHRUITSA J 
op seo og] suep afdyjnu uoNnendut.p jo JaloLneuUl oseUuUO] 
-[QULYDd .P SOpoyJOW So] oNTeAd yWOUOTeSa SUOAL SNON, 


UOISSIAGIA IP SJUIIIYJIOI sap UOHVUINS| 7 E'E 


‘soguuO][HURYSe SuoNsonb sap yueudAoId omejUsU|d 
-dns uoryeuioyur,| & np Wedsos ofdyjnur Uonendul .p souasoid 
ud UONeUINSA | B JUOWdANneIedWUOD sOVOLO.p ules nO] 
"SOO]Q S2] 9.QUD SOOUDIOYIP SIMI] 39 SouUNUUOS suONsonb sap 
SIMICUISS So] Ins s9seq soseyd xnop usd uoNeIgpuod vy 3s9 
g[dnynu uonendut.p soussoid us UOneUISd,| B DANRUIOWe 
oun, “SL‘O 3S9 p NeaTqQe} Ne soUNsdI soe sop suUeIpPoU 
RB] Jaye U_ ‘TL‘0 = ¢‘0/* onb puess snjd nod un ang yWe1A9p 
WI -"qAu™- 7-4 sastprepueys sodAj-syreo9 sop onbidéy ones 
ay aonb ‘gquoyeamnbe uose} op no ‘¢‘Q eB moLadns JUOWIIIIS9] 
ang wemop Ny / °°, onb ymsuo,s ft “SA aonb siqQrey 
snjd nod un ang yerasp “A onb jo ‘s‘Q UoMAUD & [e389 ane 
yreraap 'S~ / "°° A onbsing ‘ouO09t) B] DOAk IssNe JUSPIOIUOS 
sajg{duiod +sasuuOp Ins smMoyeuNsd xne yUoWdAneredu0S 
g[dnjnur uonendun.p souasaid ud smMoyeursd sop sanryol 
goevoyyJo | B Wey v Inb 90 Ud SUONRINUMIS sap syey[NSOI SIT 
"SB ZE 
sop 7Z suep uonendu sues smojeUIsa sop sojao onb 
sapueis snjd yuos souuaAour sonbyespenb smo smoy ‘steiq 
uleyIN0 UN.p sg~ayye Juos o[dyinw uoyendur.p sousasoid 
Ud SINd}eUSa say onb 39 ‘UoNeynduut sues smoyeurNsa say onb 
saovoyye snd yustusrapoul onb yuos ou aydyynu uoneynduut .p 


900Z eiquiscap ‘ajanbue,p senbiuyoe | 


souasaid ud smayeuUsd say onb aosed ‘opma ayuasoid PY] 
sued ‘p Nes[qr} nv SOUMsSaI SONI Sop sOYOIMOJ LI Op NoIPTU 
np oyooid yso nb ‘/6‘0 = 76‘0/ UomMAUa.p sadAj-syIR99 
sop onel un ev yUoTeAINbS jsod sooURLIRA Sop ONVI 9D “P60 
uoMAUd.p ong welasp Sa /™A onb ymsuo,s [I ‘7 neaqry 
Np « SUdAOU SOST[VOI >» SSOIPUT Sop UIP VI So Inb ‘Z]‘O 
op ddIpUI UN INog “UOHK[NUMIS Ud spNjd 91390 SUP dATOIPoId 
INQVA op dOIpPUl.| op sANneuUTxoidde uOIssoIdxd SUID 
CSA 7A — 1)Z ouuop ‘9 = SA / A roxy ye “SA sed 
(¢) UOISssoIdxd | Sp IMd}eUTLUOUSP 9] 39 INDJeIOUINU I] JOSIATG 
‘yUePUOdSaLIOD UOHLINAUIT SUBS INDCUIT}SS | IP SOULLIVA eT OP 
SIIOW VT UOITAUD & dTRSO ONO WeIAOP sQUUOT[HURYOS UOTsonb 
oun .p sUUDdAOUT BI Ip Sajd[duUIOD saguUOp soJ INs gseq N9}eU 
-Ysd uN,p souRLIeA ev] onb ymsua.s [I JoIoLneu oseuUOTN 
-ueyod p someuuonsonb sop slow vy suep onb osnjour 
}Sd U S9UUOT[HUeYSE UOTSONb onbeys onbsmng ‘jis [I SUIWOS 
“(Z neajqe} ne sogqjuesoid) TT SHNVHN 28] Op jueusAoid 
SAQUUOP So] INS soseq SANoIpsid Mayea ap SadIpuI soy Soide .p 
JUSUDISISSOIS syipoid ang yUoANod yOROTTJa,p soaysapoul 
Issne sules sog ‘[ 18 60 oNUa stIdwios jyuOos Pp nedIqQK} 
np IS [-q/Al [--q sones sap yednyd ey onb yey a] onbrpur,] 
aunts ‘uakour onb yso,U aOVOyJO.p ules og] sie ‘UO 
-eynduit sues smoyeurnss soj onb soovoryo snd juos sjdnpnuw 
uonendut p souasaid Ud sModyeuUIss soy UoWaTToMIGQe] 


ze ce oe 
i [eor ‘T) 
I 81 LT “S6‘0) 
L [S6°0 ‘6 0) 
9 [6‘0 “8°0) 
rl | [8‘0 “L‘0) 
6 [L‘0 ‘9‘0) 
Zz [9°0 *S‘0) 
w= adie ba etd: biased Bara SOTe YY 
souonbely 


soguuo][yueyos suonsonb 7¢ 
sg] nod uonendod op sauuakour sap (duos) sayayduro09 
SoguUOp Sd] INs Jo (JAI) ]dy;Nu uoNenduut,p souasaid us ‘([S) 
uoT}eNdUT SUBS SINIJVUITSS Sap soyNuITs sadAj-sye99 sop soTeY 


p neaiqey 


‘(Q]NUIS S99UUOP dp aTquUdsUd onbeyd op asdTeuR J 
solide p Imuajqo yetmod uo] anb saumsa odA}-moU9 | 90Ae 
UOISNJUOS vy JOAN Inod « aginutts odAj-ma.11a » onb 3oyny]d 
Moyeulysd uN .p « g[nuUIs adA}-11e99 »» UOISSoIdxd | SUOSTTN 
snou) odyynw uonendut,p soussoid ua simojeurnss 
sop xnoo & saja[dulod sasuUOp INS sINd}eUISd sop sarNuIs 
sodAj-sj1e99 Sop sonnel soy 30 ‘UOReIndwT sus smMojeUINss 
sop xneo e o[dnjnw uoneindut,p souasoid ua simojyeurnss 
sop sgrnuis sodAj-sjieo9 sop sonei so] oumMnsal p neo[qe} 
YT ‘(SO9TNUIIS s99UUOP ap saTquUasUa QO] Soy Ins odA}-11899 |] 
JUL}D SUIUUOD dgTNITeVd) sayo[duod saguUOp saAv 4o o[dHTNUW 
uonendut.p souasaid usa ‘uonendull.p souesqe.| Ud smo} 
-PUII]SS Sop ssvUUOT[HURYS ,p Mad | JURIedUIOS Ud soNTeAd 
a9 nod yoyduros seuuoNsonb un .p uoynesiyyn,| e nb yoynYd 
JeloLneu oseuUO][HuLYoS,| B oNp dylOVOIJO.p opiod eT 


ansojejeo ne GdX-100-ZI .N ‘epeued onbysneis 


‘UOT[MURYSS puvIs Ms suoNeUTxo1dde 
sop UONRIOI[IUIe | Sp asneo ke ‘assieq PI & JUOWIOANOU 
un Jigns Issne juorermod sjr steur ‘soyqrey snjd smoyeuru 
-OUSP Sop osneo v ‘assney eB] & JUSWWOANOU! UN JIqns B sdUep 
-U9} yUOTeINe sjURPUOdsalIOD SdSIPIepURIS SIvIQ So] ‘a]JOOI 
gyonbue oun e uoneoydde oun suep uoj[yueyoe.p soyjiey 
sopueis snd op juesiyyn uq ‘sterq sues yuoWOANneUTxoldde 
quote}9 UOTeINduMI sues sosATeUR say] onb 9}e}sUOd SUOAR snoU 
onbsind 41p yuousidoid joromneul oseuuoyyUeYyoS | e uOU 
30 UOHLINAUIT.p Sa[Ipou sa] SUP syneJsp sap eB NP JWOWI|G 
-e[quIasIeIA so ofdnynur uonendut, e onsnfuos joronneul 
aseuUoT[HuLYdS | OSI]QN Uo nbsioy opnja oyuasoid ev] op 
QIPed ds] SULP SAIOSGO JURLOdUIT sIeIq NO], °% [6 UOMAUS.pP 
JSO O]JOOI DINZIOANOD LT JOP xneuUTWIOU % CK eB SOUIFUOD 
Op SoeAIoUI sop ynposd 99 op gysIprepues stetq uN nb 
anuoul (pl osed ‘//6]) UeIyDOD ‘sasIpIepuRys sTeIq soy 
JonjeAs nod so1.yd0p susT] op asins uq jdas Jnes ‘sojzno} 
od 9‘9 & MdLISJUI 39 SION Jnes sasuUOTWUeYIE suoysonb 
So] Soyno} Inod | & MoLIOFUI jOS NTOsqe ssIpIepuR}s sIeIq 
aq onbionb ‘uonendtut sues smayeursa soy onb sAaqzo snyd 
nod un g[NUIIs asIPIepuUR}S sIeIq UN,P so}ooTJe JUOUOTeIOUNS 
yuos ofdyynur uoNendut,p souasoid us smMoayeuss saT “70 
® InaLodns jsd,U njosqe gsipsJepur}s stetq unone nb yey oI 
Jed suoneNUIs Sap s}eI[NsoI say SURP B}9]JOI 3SO IND 90 ‘steIq 
sues onbsoid yuos uoreyndut suvs sMoyzeUIsd soy ‘presey ne 
qudtaJayUS yuonbueur nb soyuenbueur saguuop sop jinpoid 
JEelIneU sseuUOTTHULYDS .p swsTUvoU oNOU onbsing 


(43 Ze [ej0L, 
I 9° 
I v1 
(I ‘9‘0] 
t (90 ‘r‘0] 
(r'0 ‘Z'0] 
v LI (Z'0 0) 
Ol SI (0 ‘Z0-) 
4 Sg is a Oi 
¢ [pos 907) 
[Di Oise Digs) 
I te 
9dnyjnu uoneyndut 9SIpiepurys sTeig 
uonenduy sues 
souonbel jy 


soouuo][yueyos suonsonb Z¢ say Inod uonejndod op 
souusdow sep ojdyynu uoneynduit,p sduasoid ud 49 
UOTE NCU sURS SINDJLUIT}SS Sop S9TNUNIS SosIprepue}js SIeIg 


¢ neayqe | 


‘soguUOT[HURYSE suOTysonb Z¢ Say] Inod sgyNuUIIs sesipsepueys 
sIeIq So] oluNsel ¢ negTqei IT (A) FAdHynw uonendut.p 
aoueseaid ud mMoyeusa,| Inod ansoyeue g[NUIIS osIPsJepur}s 
sIvIq UN IUTSp SUOAR SNON ‘Sd9[NUIS soguUUOpP op soTquIssuS 
OOI Sop eyquissua | Ins uoNRInduIt sues suOTyeUISS sop odAy 
-11e99 | onb isure ‘sajajdtu0s saguuop soy Ins jo UOnRNduT 
SUBS SUONEUITSa Sap souUdAOUT say UdWIOATOEdSo1 UD}OU 
-op Sy-gq 1 “Low Sop no 1S y-g / (Ko 
= IS-Kow) yue}o ouuOS uoTeyndut sues IND}LUIYSd | 


jaloujyew eHeuuo|iJUeYDE,p SapoUJalW Sap UOHeEN|eAs au: : UOSUYOL ja HozZ}ey ‘JayUYOS ‘ueyyeuNUBeY ‘sewou, ZSGZ 


andoyeyeo ne GqX-[00-ZI .N ‘epeueg onbnsneis 


op gINUIIs gsIpIepur}s sIvIg do] TUYSp suOAe snou ‘oguUOTIN 
-ueyoe uonsonb sun.p uoyeindod sp suuasour ey nog 


soguUO]HVUeYyd9 suonsonb soy 
inod uoyejndod op souusAow sop uoneUIns| ['¢'¢ 


‘oidyynur uonendun J e ensnfuos joroLneul oseuUOTIN 
-uvyod,| & SNP glOKDyJO,p oplod ev] 30 SIeIq 9s] JoNeAd.p 
Ue ‘SogTNUIs sdqUUOP ap saTquIdSUd QOT Sep s{quOSUd | 
Ins sajajduioo saguuop soy mod jo g[dnynw uonendust.p 
aouasaid ud ‘uoneyndut sues simojewNsa sop sojoudoid 
So] aIedu0d suOAR SNON ‘souNUTUOD suONsonb say 39 SdgUUO] 
-[Queyo9 suoysonb so] MUSAIOJUI yURSIey UOISsoIsO1 ve] Jed 
saskjeue soy 39 SoguUOT[WURYDS suOTsoNb sap uoyRndod ap 
souudAOU Sop UONPUISS | WoAes e ‘sonbyAyeue souratqoid 
ap sodA} xnop g19pisuod sUOAR snoU ‘JoIOLneU oseUUOTIN 
-uvyod Pp urd oJ Ms sgSeq SUOTRUT}SO soy JoN[eAd Nog 


uonenuns red apnj9,] op syeynsay ¢"¢ 


‘soguuo][quUeYOS suoNsonb say 39 souNUUOS suoysonb 
soy onb sure uonendutt .p sapour sj suep mMojorpesd SUTUOD 
SNOUT 939 JUWTeSO & UONLINUIS op oseUUOTTHURYOS .p splod 
Np suUYLWeSo] YT UOHLINUUIS op a}e)s eT SURP dd}IOQUUD UONR] 
-NUIIS ap oddeis vj 39 UOTR|NUMIS op ayes e] mod uonendut .p 
Q]opour a] suep snjoul 939 JUO xnedioulid syayjo soy ‘oxayd 
-WI09 gyNUUIs sseUUOTTHUeYOS ,.p ueTd np ajdwI09 Mua} Mog 

‘gquenburw UoNneULOJUT.p uonoey ej 39 (“""A) suonemdun 
OUD OULLIVA PR] SP UOTLUINSD | op UoIsIOSId eT WesJoJUOUUISNe 
suoneyndul,p siquou pueis uy ‘onbuew uoneunojsur.p 
% QS onbsIO] % 06 OP 389 SUOnLINdUT.p TUyUI oJquIOU UN 
B JUSWIDANeIedUIOS UOT[HULYIE puRIS ns suoWendut burs ap 
SANRIO SOBs | “(Tp Nes[qQeI “/Y6T) UIgnY UO]Ig ‘suONe] 
NUTS Sap s}yE]NsaI soy yUoUMTFUOS onb 99 ‘0% Q¢ ap snjd ne 
ang ‘adiounid uo qremsop “A / “A — 1 quowaaneuntxoidde 
so mb ‘oyuenbuew uoneuuoyul.p uonoey ev] ‘soquuOTy 
-ueys9 suoysonb soy mnod %Q¢ op sajyuenbueu soouUOp 
ap xnv} sop INog (966 Ulgny) aueLOduM sed jso,u ayuenb 
-UCU UONeUOJUI Pp UONoVZ eT IS nos ‘soyUesyJNs JUOW 
-o]JomMIQey yUOS suoHendut burs onb yuenbrpur souatedxo || 
J SLIO9Y} eI INS gseq sd suOTeINdUUT,p sIquIOU aT ‘suo 
-ejnduit p sjquiesua onbeys mod ayjanuanbgs uolssaise1 op 
MUYIOS]L | Sp SUOLIDIT XIP ddAv ‘sto buto ayJanuanbes uoTs 
-So1d9J Op Spoyjou v] JUoUMUEpUsdopuT yuenbrydde us suone} 
-nduil .p sajquiasus buto 9919 suoAe snoN ‘(2eAr/duus/oIsmpe 
‘YORUM Isr MMM //:dyYy) wWeMAAT jororsoid a] suep soyuoul 
-9[ duu yso ayf9,nb 9719) “(TOOT JesJoquatos yo YAMOOF ULA, 
‘TysMoydayT ‘uUeyyeUNYysey 666] JessoaoyofryueA jo 
using uUeA “WIOOYSPNO £166] [[oxorUUay) a]JoNUenbes uorIs 
-Soid91 ap S9poyjow vy] Jed agynd9xo 949 B soyUeNbuUeUT saguUO] 
-[QHuRYyd9 suoNsonb sop smayea sop oydyynur uoyenduuat J 

(T’€ WOES */ 86 UIQnY -986] JUSS Jo 
ulgny) sjdnynu uonenduilp souasgid us sayjanjouod suon 
-PUI]SO Sop o]JonjIqey suUDdAOU kT 9NOTeO sUOAR snou sind 


LS¢ 


‘gjdyynu uoneyndu red sqja[dui0s saguuop ap sorquiosua 
sop unoevyo op med ev ofjonjouod uoneumnse J JoNoTeo nod 
splod sowigul soy 9styIyN suoAe snou ‘sjdyynwu UonRndut.p 
aouasaid ud saskyeuR so] INOg ‘ssoiopuod 949 JUO sayjenjouod 
SUOTJRUISS So] Uone nd sues sosuUOT]HURYDS sooUUOp 
Sap Jo sayaTdur0d saguuOp sap osAyTeUR | INog ‘sogyndunt-njnut 
SOQUUOP Sap dSATeUL | OP SOTAINS ‘JOIOLALU dseUUOTNULYOS || 
Jed sogsneo sayuenbuew smoyea soy Jooevjduior mod ody 
-[nur uonendut,| op uoNeordde | 39 UONeIndu sues jUSUT 
-Q]JOIOILNLUI SoguUOT]WURYDS SegUUOP sap dsAjeUR | ‘UOTe}9.p 
an & sagtduios saguUOp sop asAjeuR,]| OARS & ‘SopoyjoW 
SION UOT9S UONRINUIS Ud 9pNjd,] op UoT[HURYOS onbeyo 
solide p soyjanjouod suoneunse sop nusjqo SUOAR SnON, 


UOHCWIYS p SopoyqjIW Sop uosivivduiody ECE 


‘spuUOTTHULYD9 sjolns (99 nod o]qruodsip y1e}9 oguUO] 
-[yueyos uonsonb onbeys onb sipur} ‘souuoyynueyse sjofns 
00Z I Sep s{quiosua., mod soyqruodstp jyuore}9 soUNUIUOS 
suonsenb sol ‘faroljeur uoyHueysa onbeyo imod ‘ouoq 
‘oueuuoysonb onbeys e sayoaye yuotos sjofns QQz aonb uosey 
Op SgINDOXE 99 B oTIOJegTB VOHRA, ‘(p “€) NO (p “Z) ‘(E ‘Z) 
“(pv ‘T) “(Ee ‘T) “(7 ‘T) So0]q ap somed sap oun] 39 souNUTUOS 
suonsonb say JueUD}UOS someUUONsonb xIs sap UN] & JUSUIOTIO} 
-ege sjolns QQZ | Sop UNoRYS yURJAYe Ud g[NUIIS UOTTHURYOS 
onbeyos ev 9gsodiadns 939 eB JOIOLNeUI oSeUUOTTQURYOS J 

‘(uoneNuTs op oddeis 
Jed sjofns g¢ UoHRNUIIs op aes Jed UONLTNUMIS op soddeis 
Z UOHRNUIS sp sayens gz) sjolns QOZ [ WeduI0D gynuIIS 
uoT[HUeYydS onbeyD ‘atu uoneindod ei op med e sjuep 
-uadaput saystjiqeqoid suoyueyse QO] 91 SUOAe SNON 


SPHLHVU suoTHuLyog p UoHelNaS TCE 


‘JWI. | NO oTJoUOYe UoTssold vy 39 Q1OTUY}A | NO 
d0vI VI OUD T[qQeId UdIG UdI] Ne Jo UOHRINUNS op oseuUO][N 
-ueyod .p urd of suep DIA, | 19 B[oLIaye Uorssaid vy ‘soeI PT 
INS soguUOp op UONesT[NN | & Jornonsed us np 4so vag ‘osvu 
-UO]][HULYO9 ,P SOOULLIVA SOP UONCUNT}SO-sNOS OUN 39 SddSTRIG 
suUOT}eUISO sop oiMpoid yeLMod saguuop sap sasdyeue 
So] suep uvjd np sonbystisjovies say Joous1.nb suas 99 ua 
SOATILWIOFJUI JUOS OpNjd | SURP SddST[N oxoTduI0D sseUUOTIN 
-ueyo9 .p uvjd np sonbystigjoeres say] ‘uoneynus red apne 
9109 suep ‘ouUdAOUT Ud ‘[‘Z Op dIPIJO J op JUaTe}S UONendod 
ap souusAoul sop uoneUss., Inod urd ap sjoyo so] 


OGM OAT PSY CRP ON ES 
“en x “in = Mm eyo [eu UONeTNUIIS op osvuUOTIN 
-ueyod p splod 9] ‘suuor[nueyos yolns onbeyo mog 
‘2 jolns np o8em Jonueid ap UOKoeTas Op syITIGeqoid 
ey ajuasguder Pu no “Tx 2% mn yea 9 adders 
R] Suep 7 jolns a] od oIsap swaTxNop op UONRTNUIIS 
ap osvuUO][HUeYSS .p spiod oy s1oye ‘og & amoriodns 
wel Y oyeqs e] suep 2 oTIe) eT IS “T= Pm ye 


900Z eiquisc~ap ‘ajenbusa,p senbiuyoe | 


2 oddeis vj suep 7 jolns a] mod sisap ouwerxnop 
ap UONRINUIIS op sseuUOT[HULYSE ,p sprod 9] sIOTe ‘OE 
B ged JIR}9 Y DeNs el suep 9 oddeis v op oIIIe} P| 
Se etn CPSP rr eas oF 
snjd sayLio9p Juos saya nb sayfa} UONR[NUNIs op soyens 
sa] Y¥Y 30 UONRINUMS op o}eQs ouN sup soguUOTIN 
-ueyos soddeis soy 2 ‘uoneinumts op oddeid oun suep 
souuol[nueyos sjofns soy yuRyosoIdal SOIpUl,]| 7 WOS 
‘9SLZ‘0 & €N00‘0 OP JoreLIeA UOTRINUIIS op saddes3 
So] SUepP o8vIN JoMUOId op UONOOTaS ap sayTTIqeqoid 
SaT ‘yolns 29 ap UONDETES ap ayITIQeqod SUUIOD Jolns 
anbeyo Inod dsiynn jUR}a OSITPULIOU SSIOAUI | “UONR] 
-nuis op oddeis onbeys suep | e& a]e39 OS OUTUOS 
Ia] anb a0 ap T]] SHNVHN 8] op Uorsnyyip spuess 
B SosuUOp op JOO np uoyHuUeyos,| sp yueusaoid 
XNCUISIIO Splod sap SdSIOAUT So] JURST[PUIOU Ud oseIy 
Jaruoid ap UONdETAS ap soy]Iqeqold soy sfNoyed SUOAR 
snou ‘sjafns g¢ op snyd yueusjuo0d soddeid soy Mog 
UOTTHULYE | SURP SNJOUT 939 JUO syofns soy sno} ssO;e 
‘OE & aTes9 Weg oddess eI op aie} e] Ig “soyquieA 
UOTOSTOS Op soyIqeqoid sop ddAv SSTUUIOI SUBS PIeSeY 
ne sjofns Q¢ 91] SUOAR snoU ‘agUUIONOII9S UONe] 
-nunis ap oddeis onbeyo op ised e Suowrourerxnoq 
‘Y UOHLINUIS op des 

eB] Suep UOneINUIIsS ap soddeis op oiquiou 9] 3so “PY 
no ‘OZ “7 T=4‘7/ "PV = “im qreig adejg ooo & 
juepuodsaIOS UONLINUIS op osvUuUOT|HURYDS .p sprod 
9] “xNeSOUT JUSIE}D UOTRINUIIS op sayeNs (QZ So] SULp 
uONeINUIIs op soddeis op soiquiou soy SUUOD ‘asTu 
-1 sues oduns omojegye oseuuoT[MUeYSS Jed uONe] 
nus ap soddeis xnop 914) suoae snou “UoKe[NUIIs 
ap ajens onbeys mod ‘juowo19WoIg ‘jURAINS soIsap 
xnop & oseuUO]HWURYyoS .p ued np udsdour ne uoneNU 
-IS op osevuUOTHULYOS Pp splod soy SUTLLLIO}OpP SUOAR 
SNON :UOHRINUIS sp ssvUUOTHURYII,p splog 


‘36°C OeP HERES 
uonrnuns op oddeid sed sjafns op siquuiou 9] 10 “SZ 
B € Op PeULA UONLNUIIS op dens Jed UOHeINUIIS op 
soddeis op oiquiou oJ ‘uoneinumts op oddeis onbeyo 
suep soTqeLeA sion soo od ossepoR.nUI UONIALIOS 
oP SUOIPUOD sop Jo9IO op ue sodnoidel 919 JO 
SOML]IUIS JUDTL}ID SINI[VA soy sjanbsay inod sjafns sx] 
‘(COND 27]210d109 osseu op sdIpUuT,] Ins 39 onbrjo}seIp 
32 onbrjo}sAs aTJolaye uorssoid ve] Op soiNjoo] Soy Ins 
sexe onbisojod4} asAyeue one oun Ins yUepUOJ snou 
ud soyeuIsO soddesd sa] Wedoi suoAe snou “‘uonenu 
-IS OP SoVS YZ Ud SaTBUISLIO saves Gp Sa] odnois 
-O1 MOAR Soidy ‘soyeUIsIIO sayeNs Gp Sop ouNovYo 
suep soddeis 7 oup-e-3sa,0 ‘soddeis 36 a0dwWO09 
Il SANVHN ® 9P UoIsnyIp epuess eB soguuOp 
op Jomo np uoyHueyos,T : woyemuns sp soddesy 


mC 


ansojeyeo ne GdX-100-Z1 .N ‘epeueg onbysnejsg 


‘sosAyeur 
So] SUep UONRISpUOd ve] op souRLOdUIT,| MID0e eB Inb 
90 ‘soJURI[NSSI UONLINUTIS op soyes Soy aU oTeIORI 
MIdUSSOINOY,| Qyuowsne JUoWTes9 e sopueIs snjd 
SNS SP UCHLI ap spoyJoU aad “UOHRINUIIS op 
SayeS (7 INO} Ud SUUOp ke INb 99 ‘salJOs9xv9 yy sap 
sUNdvYD SUP UONLINUMIS sp sayeys SION NO xnap 9919 
B SO[CUISLIO SoyVS Sop UOSICUIQUIOD BY “JOUTGUIOS 
OP WeUSAUOD [I,Nb soyeuIsUO sayVs so] JoUUOTDEIIS 
Iod 93e)s k] 9p NesAIU Ne souR[g-uoU op suoTodoid 
So] juRsT]yN us onbisojodA) asATeue oun e gpgd0id 
SUOAR SnoU ‘SolIosgyed jy soo ap suNoRYyO sued 
‘(xneoATU xnop) smMNoLsy jo juownIedaq saris 
poyuy, np spod 9 IMs dgseq sUTeGm/o|emI UOIsaI 
op uoHeMIs eI op Jo (xneoATU anenb) JUoUAsUDDOI 
Op UOISdI B] Op JUotUSdNode1 Ied sadUUIOJ saLIOsqyev9 
yMY sp oun] SURP d9SSRID 39 B SoTeUISLIO soyeNs 
6p Sop ounovyy ‘aJURAINS UOSdSe}] eT Op UOTNEINUITIS 
ap SHVNS QZ Ud SPUISLIO saeNS GP So] odnosseI 
SUOAR SNON ‘aJURSYNs jos sgmNUIs suOTTHURYDE 
sg] onua one] e UoTWUeYyDD UN,p UONeLIeA 
eR] onb Jomsses mod ‘soddeis ap srquiou puess snd 
UN SUNOeYS JULUDJUOD saje.Ns op siquuiou yed snd un 
J9919 B HIeISISUOD UONeNUMIS Ud opNjd | Inod ‘arsayeys 
ey] ‘soddeis Z sunovyd JURUdUOD sayeS GP OJOdUIOD 
II SHNVHN 2 9p UoIsngIp epuess e saguUOp 
ap Joy np uoyHueyss, JT : UOHVMUNS op saVnS || 
‘(II SANVHN 8] 9p [euIsiio aseuuo]HUeYS9 Pp ued np 
SgTqelLieA soy 30 soyQUeNb sao aHUS UOHOUNSIp ve] ome} mod 
gsT]N sd « UOHRINUIS op» JHeoyTenb oj ‘tor) UONe[NUTIS 
op osvuuoTHueYysE.p spiod (¢ jo uoNnRNUIs op oddeis (7 
UOTEINUIS ap aens({ Moaes e ‘ay uonendod xy e 
eseuuo][yueYsS .p ued op soyqeLea sion synofe suoAe snou 
FnIalgo 390 JasTjesI Mog ‘aystjeo1 snyd UoHeNurs red opnjsd 
oun Jo910 op uye ojduns onojegye oseuUo[QUeYyoS uN nb 
yoin|d ~oxojduios sseuUOTTHULYOS.p uejd un suOT]HULYOS 
So] JouUONeI9s Mod gsI]WN suCAe sNnON ‘UoHRndod 3)399 
op Imed & som} 939 yUO sojodo SUOT[HURYD9 sop jo SIUTT UO] 
-ejndod oun sum0d soyte 939 JUO | NeaTqQu} Ne sooioWINUS 
SO|QVLIVA So] INS sajadwi0d sssuUOp sap TWIMOJ jUsTeAe 
mb []] SHNVHN 28] ep siefns 6SZ I] soy Quenbgsuos seg 
‘nedoi oseuuo]]HUeYDS snos sosIpNyd sopoyjsu sap sonby 
-syeys sojouidoid say Jonyeag.p sed yrenjouied ou soguuop 
ap s]quuasud [Nes UN IMS d9Seq OpNjyd OUN STRUT FJreULIOJUT 
SOU9O HCIOS BI9Q TIT SANVHN 8] op Je[dwoo uoHURYyse ,] 
e sonbydde ang yuorexmod ofdyjnur uoneynduwi,p soussoid 
uo osAjeue], jo jolOLyeU oseuUOTHURYOS.p uvd os] 


ssvuUuoTHULYy II ,p uLd 39 UONRINdOg [°7'¢ 


II] SHNVHN #1 2p Seguuop sof 
ANS a9puoj UONL[NUIs 1vd apnj9,[ 9p UONdsDU0D = 7°¢ 


jalouyeww eHeuuo||UeUDS,p Sepouj}eW sep UOHeN|eAs BU: : UOSUYOT 39 ozjyey ‘’ayUeYoS ‘ueUJeuNUBeY ‘sewou,  QGZ 


ansojeyewo ne {qX-100-ZI .N ‘epeueD snbysneisg 


‘JUOLUQUR} [NUTS sUOT|soONb say soyno} Inod 
solqesijeai juatuoressao9u sed jos ou jo yUoUIZIed9s UONSoNb onbeyo mod sguruojgp yuos xneuINdo syyoIpgid sooIpul SOT : BION 


Z1‘0 60°0 80°0 Z1‘0 60°0 80°0 v (ALOVUVLVOVIIOVH 
60°0 L0°0 r0°0 60°0 L0°0 L0°0 v (SNIOJ SAG ANNHWHIOVH 
Z1‘0 Or‘ O10 Z1‘0 Z1‘0 O10 v (ALIHONOY)ALOVH 
v7'0 07°0 81°0 7a) 070 610 pb (TWadseA TIVINOSVA LNAGIOOV)CIOVH 
610 I1‘0 L0°0 610 I1‘0 L0°0 v (SNOLLVSITV.LIGSOH.C TUAWON)PadVH 
80°0 00 500 80°0 500 500 € (ANOMAS Wad dad 
Z1‘0 I1‘0 O1‘O Z1‘0 ITO 010 € (ATTAN.LOV TANAH.T V ANNA EAVH 
r1‘0 r1‘0 E10 r1‘0 v1‘0 £10 € (SATd NO SALLIAVOIO 001) TAVH 
IZ‘0 Z1‘0 L0°0 1Z-0 Z1‘0 L0°0 € (SONIS/A.LISONIS)A61TVH 
Z1‘0 Z1‘0 80°0 Z1‘0 Z10 80°0 € (AISATVUVd/ASSA TEV) €ETAVH 
670 all) £70 670 67.0 val) € (ANIULIOd VT SNVG UNATNOG) I AVH 
170 070 810 1Z‘0 070 610 Z ((7P/8n) GNOTd) ddd 
910 a) ITO 910 €1‘0 Z1‘0 G (ADV NOS YNOd (AA)ALLOV)87.LVH 
S70 S10 r1‘0 S70 S10 r1‘0 i (SLNVAOWRV TI XNdA)al ITVH 
Z1‘0 710 IT‘ 710 Z1‘0 Z1‘0 G (LNAWASSIGUNOONA)b7IVH 
STO L0‘0 L0‘0 STO L0‘0 L0‘0 - @ (ANNAIGIOUAHL AIGV TVW) AIOVH 
€1‘0 60°0 80°0 €1‘0 O10 60°0 iC (AWHLSV)d1OVH 
er‘0 0c‘ 970 €v'0 0€'0 970 I (ANOMAS ASOONTD)dID 
670 L70 del 670 BO LI‘0 I (XNVSVN SANOLdINAS)VIITVH 
€1‘0 90°0 500 €1‘0 90°0 $00 I (WHONVO FTYLAVIOIOVH 
ST‘0 70°0 70'0 S10 r0'0 70°0 I (FULIOD)[1OVH 
Inouedng  udtdop IMowoyu, IMousdng uoskopY Mogul s0o/g uonsond 
SOST[BIY xnewndo 


672 


[oloINeU oseuUOT[HULYDE,.p UL|d 9] suep 


soguuo][yueyos suonsanb say Inod J] SYNVHN 2] 2p seeuUOp sz] Ans soseqg sANoIpoid Mayea ap sooIpuy 


p— sguuoyTnuRYSY 
p — sguuoyTnuRYog 
p — aguuoyTHURYo 
p — souUuo]THuRYoR 
p — spuuoTUEYoR 
p — epuuoT Huey 
p — oouUO][NUeYOA 
p— a9uuoTauEyog 
y- apuuoy[ueYoY 
€ — o9uuoT[HURYOA 
€ — sguUOTTHURYOY 
¢ — apuUOTNUEYOG 
¢ — aguUOTURYOY 
5 apuuoy[ HUEY 
€ — sguuo][HURYoA 
€ — apuUO HUEY 
Z — spuUOTTUEYOR 
Z — a9uUOTHUEYOY 
Z — apuUO]NUEYDy 
Z — epuUOTURYOS 
Z — aguuoy[UEYoY 
Z— apuUOTHULYD 
Z — aguUOTURYOY 
Z— spuuoTHURYY 
Z— opuUoTTURYog 


7 — spuUOT|UeYOY 


Z neayqe | 


DAITP J1e}9 UINSUeS JOID\saTOYO op xne} 9] onb yp & INdjD0p uA, 


1091109 /JURST]JNSUI/JISS9Oxa }So splod uos aonb s1apisuoDd 
UIMBULS [OI9}SOTOYD 9.1}0A SIJLIOA Blop UO-]-V 
939eIe]e9 : ZOTAR SNOA onb yp elop [I-}-B snoA Insy90p uA, 


SUIOJ Sop otUNYA : ZoIAe sno onb jp elop [I-}-e snoA In9y00p Up) 
onbruoryo oy1youoIg : ZaIAe sno onb jp elop |I-}-e snoA Indy0p UA) 


[e1Q9190 SITR[NOSBA JUpIOv : ZOTAR SNOA onb jp efop ]I-}-k SNOA In9}90p UA), 


suonesteyidsoy ,p s1quiou ‘sIOW sIOTUIOp Z] Sop sInod ny 
(,tu9/8) 21830} UOISaI ‘asnasso syesJOUTU 9}ISUAq 

oMoyedxo [ewWIXeU 11gQ9q 

g]jonqoe oINsY | B SdyoIeSIO sop snoa-zouNn.y 

SIA O1JOA SP SINOD Nev snyd NO sayoIVBID QQ] SUINy snoA-zoAY 


SNUIS Op sUIgTQOId/S}ISNUIS : Nd B ‘SIOU SIOTUIOp Z] Sop sINod ny 
soynuru ¢ op snjd yuepuod oquuel vy ‘seiq oy ‘adesta 9] Sup oIscTeIedossolqiey 


duLyIod ev] suep duds 9UN No IMe[nop oun no elop VY 
(Tp/8n) onbugs J0J 

(Jul) spuess snd ey moyea “TAD 

(TP/8n) quioyg 


988 OIJOA OP SOUTLUAJ/SOUTUIOY Xne JUOWOATIeIedUIOD (9A)FIOV 


stuoumnoud : no e ‘sIour siaTUJap Z] Sop sInod ny 
oddiis no oumnys : no & ‘SIOW! SIOTUJOp Z] Sop sINOd. NY 


SIOW SIOTUIOp Z] SOP SINOd ne yUdT]INoyeyYo Ib ‘syueAoue] xNI_ 


soynurul ¢ op snid yuepuod sdioo/esesiA np 9309 UN, p *'d}9 “JUOTUASSIPINOsUy 


QUUSIPIOIAY} SIpe[eU : ZOTAR SNOA onb yp efap |I-}-e SNOA INa}00p UA, 


adA |, 


oUY}Se : ZOIAB SNOA onb yp efop [I-}-e SNOA In9}D0p Up) 
ayoury op Ino}-d]]1e} op Ino} oneYy 


«LOVH 

x LTNVH 
*9HAVH 
ITOVH 
HIOVH 
ATOVH 
CIOVH 
vaVH 
xCWNdOLddd 
x 1VAdddS 
CuvH 
TaVH 
ad6lTVH 
€CdVH 
IIVH 

dd 

«x AdddS 
ddd 
87LVH 
*xJ61TVH 
*«V61TTVH 
a1 1TVH 
vCAVH 
SIOVH 
AIOVH 
*xTHMdNd 


g[qeliea ey op uoNdiioseq 
Il SANVHN 8] Suep sed juorems3iy ou onbsti9}se un.p soonbiew suonsonb sa] 
“UOTENRAD | SUBP SdsNyouT 939 UO INb []] SANVHN EL] op seyqueA 
(ams) | nevepqe y, 


900Z eiquwsscep ‘ajenbue,p senbiuyoo | 


J[QelIeA e] Op WON 


andojeyeo ne GdX-100-ZI oN ‘epeued onbysyeis 


[ — 99uUO][WURYOY SIOW SIOTUIOP Z] SOP SINOD Ne [eseU JUIWI9[NOIE No JUSUUATTINOyeYO “Inepsno 7] VIITIVH 
I- apuUoT[UeYOY jueYoIeU Ud soquiel xnop So] suep INayNOp vk] op JUSssay xP lIVH 
[ — d9uUO]]HURYOY Joouvd one : ZaIAv SNoA onb yp efop JI-1-e snoa In9yo0p up) OIOVH 
| — d9uUO]THUeYO| nead e] op Ja0uvd : ZaIAv snoa onb jp efop JI-1-e snoa inayo0p uA, xNIOVH 
| — 99uUOTTHURYO| OI}103 : ZOIAB SNOA onb yp elap |I-}-B snoA Ind}OOp up) flOVH 
| — e9uuo][ueyog (Tp/sur) onbuigs asoon|H dID 
SuNUMO) (Jut/n) enbugs ourjnsuy dll 
oUNUIWUOZ) dxag XASSH 
ouNUIWOZ (uondeyasoid op orreuUONsanb) osnAoqud,| op JUOWIOW Ne odVv WIAOVSH 
ounumw0?d SdQAdYOR 91099 ,.p SaguUB,p sIqQUIOU NO dAgI9 snd 9] opeH U8VAH 
ouNUIWOD etuoWLAeU 3e7yq ZIVAH 
ounuIuo7) Wa) 19 o8eusu-orreuuoNsonb saide,p suuakouw oy eg USMNWZVH 
suNUIWUOZ) Wd) 39 oseusu-sireuuonsonb soide .p suussoul [y ed UESINANZVH 
ounuIWO7) uaqjod 9] red soyouajoop souroyduis avl1IVH 
ouNUIWOD SIOW SIOIUIOp Z] Sop SINOd ne suLIjIOd ve] suLp S]USUOTJIS sop no V 9TVH 
ounuIo?; o9uue | suep snjd no syynogsuoo stow ¢ ‘sinof sop yednyd ey xnoy lTVH 
ounWWw0D soynurul ¢ op snid juepuod oaeis yUSWOSsIpIN0}q 974VH 
ouNUIWOD anbeipieo asiio oun yey ZaIAv snoa onb yp elap |I-1-e snoa na}o0p uA) OIdVH 
SUNUTWOZ) uorsuoyodAy | op ZoIstej snoa onb sioj xnop surowl ne jIp & SNOA UD cqVH 
suNUTWOZ) d}9qQRIP 9] 91]U0D sornyId sop snos-zoudid ‘yUsWIOW J] INOg OIGVH 
ounumWu07 9}0qQRIP/aiONs np ZatAe sno onb yp efop uo-}-e sno, IGVH 
ounuIWO,Z 9)1N0S8 : ZaIAe SnNoA onb yp eflop |I-3-e sNOA IN9}00p Up) WIOVH 
ounUIWO,) sndny : zotae snoa onb yp efep [I-1-e snoa in9jo0p up, STLOVEL 
ouNUTWwOD dAT}SO3UOD onbeIpsed soURST{JNSUT : Ie[OSp & INd}OOp UG) JIOVH 
ounUIWOD IN9d}DOP UN ZIYO SO}ISIA dp dIQUIOU ‘STOW SIOTUIOp ZT] Sop sInod NY xSAVH 
ouNUTWOD 9]URS OP SUIOS sap I1U9}qQ0 Inod JaTNOHJed loIpus uN suep pUudI ag «CAVH 
ounuw07) OSTRANCUI “*** “OJUdT]IOX ‘[e19UNS Ud ‘oT]O-1S9 QJURS BOA, IadVH 
suNUIWO’) (%) d9}8dA]S DUTQO[SOWIDH xdHD 
suNUIWO,) BPS] 9POd 9] IMs 9seq oUTeqIN/s]TeINI UOIS9I 9p 9pod OUWLANdNG 
ound, (png 9] suep sexo.) UoNelopuod 4uoWasUddeI Op UOISdY NOAYOd NG 
Sun) PHOTUYJO-SOeY NHLAYVNG 
ounuIOD) (Tp/Sur) onbugs Jorg}so}oyD «dHO 
suUNUIWOD Q][210d109 osseul op SdIpUy INGd NE 
adh g[qeliea eR] op UONdIIOsoq ==: IQuIIeA BT Op WION 


Il SAUNVHN 8] suep sed juaremsy ou onbsti9jse un,p soonbiew suonsonb saq 


woHeN|eAg,| Suep SasnjouT 939 UO Inb T]T SINWHN XI op sayqeizeA 
[ neo[qe 


"p}0 €'€ SUOIES So] OA UOTsanb 33399 op 
atpuojoidde snjd uorssnosip sun Mog ‘JOOLnvUr ssevuUOT[N 
-ueyoe p urd 99 suep o[qiey JUOWIOANRIOI yso soynduit 
-JNUI smayeuUsa sop oyovolyje, onb sosuod e suuop 
mb 90 ‘070 & SIMOLIQJUI JUOS BUUOOD 93399 sULp jURINST 
synoipoid saorpul [7 Sop Jnou-xIqj ‘seguuoT[HUeYdE suoTsonb 
Sd] Inod sagtBATUN souUdAOUT Sap sind}eUIsd sap onpusye 
UONLIONSWe | INS SOMILIQJUT soUIOG soy SUUOpP « sasITeay » 
snos « mMoLIgjuy » sgjonbys Z neojqe} np suUOjOD eT 

‘ZQ0‘0 op onb 3s9,u sos 
-TTW91 JUOUUDATIOAJJO sjuepuodsaiI09 soadIpul say 39 xneudo 
syorpeid saorpul soy o.Ue UdAOUT 1Ied9 | ‘aTdWIoXa Jeg *['7'Z 
UOTIDIS BI Op Sd1gLID 9] mod yeurmdo onbsoid 4sa_ Istoyo 
ued oj onb onuour Z neolqe} a7 ‘siornonsed soo]q sap ke 
Tu suotjsonb sap ev sed JuospuodsasI0d dU SOIPUT,p SINITeA Sd] 
yULUD}UOD NevITqQe} Np soUUO]OS soy onb oyOs ap ‘aosapIsuod 
uoysonb onbeyds mod saagz9 snyjd ey e ayqiey snjd ey op 
SO9L] JUOS SOIPUI.| Op SIM]eA so] *(« SasiTeay ») UoNsonb us 
uoysonb ey sed yueUd}UOS OU SOOTq SIO.) Sd] SUBP SUTIOTJDOTOS 
ued np UdhOUl Nv SddST[V9I JUSUDAIIJJO SOIPUT | SP SAdAZI9 


snjd say smayea soy 30 (« xnewdgO ») s9usa0U09 UOTsonb 
eR] op smojorpoid onb jue}, ua soguuOT[WUeYysa suoNsonb 
sone soy Mod soagpe snjd soy syyompesd soorpul sioN soy 
‘« DOTA ») aa}0gTFe 939 B UOTJSoNb x] Jonbne oojq 9] : syuRATNS 
SJUSUIOUSIOSUSI Soy oUUOp Z negqe) oy ‘TT SHNVHN 
eR] suep ems inb souuOT]WURYDS UOTNsonb onbeys og 
‘SoQUUOTTHULYIE SoTquLIeA Soy Inod goaFJFe D0]q a] aonb 
ISUIB ‘SOOUUOT[NULYIS SOTQeLIVA Soy] JO SOUNUUTUOD sorqelieA 
So] yUOS soyjonb onbiput | neojqe} np « add] » ouUOIOD 
BT] ‘oyeso yuoWoAneuTxoidde omowoap 10-xnoo0 ap Monsuoy 
eT onb 99 & UOdSRT Op SoOTG xNe jUdIONOWeIIe saga 
yo sonredo1 939 JO J] SANVHN 2] Suep sed juoremsy 
ou Inb saguuoyHUeYdE suoNsanb sa'q (‘s}aTdut09 sed say JUSU 
-onbrun jueshyeue ud [J] SANVHN 28] op soouuop soy suep 
soyuenbuew smajva sop uonsonb vy] 9}1e.y SUOAR snoU ‘sozes 
-Sd09U SOOIPUI Sop UONeUINSd,| 9p SIOT) TT SHUNVHN 2 
op JueUdAOId SagUUOp xne Z UONDIS BT B SAdIOQLID SOPpouoU 
soy quenbydde ua soojq xne sagjooye 939 UO [] SUNVHN 
Re] suep jyuoremsy mb soguuoyuueyss suonsonb so| 
‘anno Uq ‘SOUNUITODS suOYsoNb sa] soyno} jreUud}UOS UNdeYD 


jaioujew eHeuuo||UeYOS,p SepoujyeW Sep UOHeN|eAs BU) : UOSUYOL 39 Jozjey ‘WayUSYOS ‘UeUJeUNYHeY ‘sewoyuL Bpz 


ansoyejeo ne GqdX-[00-ZI oN ‘epeueD onbysneig 


‘sooyg anenb sdav INSUOS 939 B [SIOLNeUT os vUUO] [HULDA _P 
ued of ‘ney snjd suUOnUSW sUOAR.] Snou sod 
"WOU Ind] op 9300 & onbst19\se uN Jed soonbrput wos (a\sI[eoI 
uonenis oun ‘neoanou op) I] SANVHN 28] Suep uoU sTeur 
IIT SAUNVHN 28] Suep juaremsy mb sajqeuea soy ‘sasnjour 
SOTQeLIvA Sop UOTdIIOsSap dAdIg OUN oUUOpP | Nee]qe} IT] 

‘O]Q SUIQUI 
3] suep oo B sUOTJsONb xnap sad gdJOJ B ‘7'Z UOTIS PI kB 
yep ‘sooyq xne sasuuoT[WURYSS suonsonb soy J0\90IFe nod 
gsN ouUNyWOse,J « Zayjomjoe amMoy.] eB SNoA-zowN » 
op SIAINS « ZdIA SOA OP SsMOd ne snd no sayore3Id YOT 
QUIN SNOA-ZOAY »> : OSNOUI 949 & JUSIUIDUTeYOUS UN JUPUTIOF 
suonsonb op omed ouy) ‘aMoyeJogr] op samsou sap jo ajonb 
-ud,p suoysonb sap jueyuasoidar sonuUOS jd soeUIG so{q 
-CLIPA Sop yusUUdIdUIOD saguUOp op sodA} sa] ‘ouTeWOp np 
soystjeloods sa] S9AB UONRI[NSUOD Ud Sd9dUUOTJDITIS 939 JUO 49 
a}onbus | sup s}JoAnod sjofns sap siquiou yuRyUOsoIdal suo} 
-sonb say] yuouuordwio0s spd, mod sonudjel sopquitea so] 
‘So[qeleA op siquiou pues snd dnoonevag un JoyeN op yey 
-joullad 9stpyn Ja1o1so] a] onbronb ‘sjqeigs amoulap 10-d]]90 
onb uye opnd,] Suep o[quIosud-snos uN .nb snjouT suOAR.U 
snou ‘TIT SANVHN 8] op sorqeliea say sayno} ap asAyeur | 
39 uoloenxd | sud yemenb sdwoa} oJ ouuop jue 


Il SUNVHN 
B] op yuvUdAOId osessyUuIidde .p soguUOp 


S3] ANS QPUO}J [ILILAVU VSvUUOT[HULYII,p UL[q I['¢ 


"p’€ UOTIAS BT B SayLIOOp 
yUOS ¢°¢ B ['¢ SUOT}DOS xne sodpsloge sed yuos ou nb apm9,] 
OP SOU] SOUTeLIOD “¢°¢ UONSIS eT B SoJUasoId yUOS apNjd,| 
SP SEVNSST Sol Ce UOHWSS B] 8 Dep 82 TILSANVHN 
RB] op soouUOp sop UdAour ne UOyLNUTIS Jed opmjd,] op uejd 
XT Te donses ef @ unser 389 IT] SHNVHN ®] 9p Sepuuop 
So] JURSTTIN Ud 9910 JOIOLNRUT oseUUOT]HULYDS,p ueTd aT 

‘dodos OSeUUOT[HULYIS SNOS SOpOYJOU SASJOAIP 
sop s9}9Udoid sap suoneurse sop Juostnpold sgynutis suoT{n 
-UBYOE Sop s[QUIdSUd | INS soUINsaI s}eI[NSOI soy ‘(UOTeII,] 
OIIP-B-4S9 9) SaJQ[dWIOD saguUOp ddAv SUOTTHURYDE Soy 30 oTdy 
-[nu UoHRnduwut oun,p soudsaid Ud sjoIOLneW suOTTHURYDE 
So] ‘UOHEINdUIT suBS S[OIOLQeU suUOT]QURYDE soy] JURST_QN 
uo sashjeue smoisnid gsitvor suoAR snou “UjUq ‘[OIOLNeUT 
osvuUo][NueYoS | B sonp sayuenbuew smoyea sop sidyynu 
uonendut., e sps00id 39 uoT[HUeYDS onbeyo ke JeIOLNeUL 
oseuuo][nueyse .p urd 9s] ssoduit ojinsud suoAe snoN 
‘< UOTL}9 » DOU JUONYNSUOD 10-xNdd ‘sg[NUUIS suUOTTMURYDE 
sop unorys mod sajqruodsip jurj9 sajotduiod saguuOp 
SOT ‘So[eSOUI UOT}DIIIS Op soy[Iqegoid saAe soisap xnop 
B oyhens oseuuoyHueyse,p ueyd un uojes TIT SHNVHN 
eR] op omy uonemdod ey op smied e& suojnueyss QOT 
O11} SUOAR SNON ‘ou UONR{Ndod spueis uN sUIUIOD soyIe.y 
919 JUO sofqeURA op sUUOTDOTIS s;qQuIdsuUd UN mod soajajd 
-W0d saguUOp sop juaTe}stxa sjonbsay mod |] SANVHN 


Lvc 


ey] & sjuedionsed say [I] SHNVHN B®] op sdeuuop soy soide .p 
S991 SO[NUIS suOT]HUReYOS smoisnjd e quia Isule uLyd 
9] onbijdde suoae snou ‘sing ‘ojonbus ayjaanou oun .p oreU 
-uonsonb 3] MOAdNU0N Mod sagsI]yN JOS smMotgUe aJonbus 
oun.p jueusAoid saguuop soy a]jonbe] suep o[Joo1 UOTeNyIS 
eR] oynuts uvd ag ‘7 uONdes BI & OILIOOp opoyjow vy Jed 
Jolomneu sseuuor[HueYyos .p urjd un J99I0 nod (SGNVHN 
oUgIxNsp ke] “oJIp-e-189,9) TT SHNVHN 2] 9S!]9N suoae 
SNOU “IOOUSUTUIOD INOg ‘UOTeNTRAY,p 9pNjd oUN sI[edI SUOAL 
snou ‘SANVHN e] enb oJ} aJanbua oun mod Jo1oLnyeur 
oseuuo]nueyos,p ued un.p sy]Iqestey vy JonjeAd mod 


SANVHN #®I 29P 
yuvudaoid saguuop op UdAOU Ne OpNA” “¢ 


‘(T'7Z WoNsas BI B OTUIJOp 389 oT]a Nb o]]9}) aANOIpoid IMnoyea 


~ BL Op o[eqoys oMsoul SMaT][IOW e] JWeUUOP INJIO IsIOYd SUOAR 


snou sind ‘juawanoyesye saUUOTD0TES SyUOWASsR[D SOAR 
souatiedxa.p surjd QoQ | a19ues suoAe snou ‘souvpuadgp 
eR] ouINpos Nog ‘({ 9dv}9,] B) suoNsonb sop yeNIUI yUOUOSseIO 
ne d]qisuss yuowouUdAOW 4sd sUTYLIOS[e,] onb sosuod 
8 oUUOp SANVHN 28] op sesuuop soy d0AR doUDLIOdxa J 

7 odeya.J & (,) A mod agsiyn a]J20 onb ammpgooid 
SUIQU ev] JURAINS UD ‘7 ode}9,] B QUUONDOIES IMjoo onb s0]q 
ogne un & ((, { B sgl] UONsonb ano} J) |, { Joyay “SoAy 
-oipoid snjd sof juos ua inb *, { suosIp ‘sajuRysar sogooye 
uou suonsonb say JaAnon “(soat] Juos A tnb suonsonb so] 
No (A) 7 dei] & ag}aFe UONsonb onbeyo og ‘¢ adeyq 


“QUUOTIOIT9S 9OTG Ne JUSUUATeS9 
JOJOAJe S2] “(A &B SOQ! SUONsanb sap 9jSTXo [I,S “So[qISsTUU 
“pe soojq sep janbsy oyodunu e .,{ Jojoaye ‘onbe xo 
un ojsisiod ]I,§ “(4,4 mod ojqrey snyd a] so (Z*X | (AT 
uINWTXeU FHOIpeid sorput | Janbay nod myoo eR , { Jojoaye 
‘eso ev JOS soo[q smorsn{d Ig ‘suonsonb op siquiou 
ned snjd o] JUeUA}UOD so;G Ne *, { SUOSIP ‘ag}oefye UOU 
uoysonb (eigrueid ej no) oureyooid ef Jojoyyy “7 odeyg 


"Sag}OOTJe 939 JUSTe SUONsoNb sa] saynoj aonb 90 e nbsnl 
‘uoatns tnb ¢ 30 7 sodeja sap uonnedar sed ‘uoueTjonuonbes 
ye} OS soojq xne suoljsonb sop uoepayye,T ‘soouUoy 
-[Hueyo9 suoysonb so] jowWoNojyeg[e JouUOpIQ ‘[ sdeyq 


"['€ UOTAS FB] B SUO.QUOWISP do] SNOU SUUTUIOD 
‘SANVHN 8] Op uoneorydde, mod xneunjdo onbsoid 
syey[NsoI sap suuop jo odumts snjd yuowrayou yso ys nb 
MUYWOS]e | ‘UONesTuUTxeU 34300 eB soonbijdde ano yuassind 
solgnus uoneUUeIsOId op sapoyjou soy onb ualg ‘sogr[ol 
JUDWDT[ONJUdAS suOT}sONb sap d9Av oyTeB9 JUSIUDATFeUTXOIdde 
INMNSUO] Sp SOO]q Sap 19919 ap oyIssooou vy Jed sogsoduit 
SOMVOUT] SoJUTeQUOD Sop s;quIdSUd UN snos ‘UOTOUOJ ouN.p 
(soojq xne suone} oye) sorauUd sognud.p afquiosud un 
INS SOSTUTXPU 99 JUSAIOP [°7'Z UOTIS BI Op SILO ST 


UOHLVIIJV Pp WUIY IOV UQ 77 


900Z aiqwsc~ap ‘ajenbuse,p sanbiuyoe | 


‘ueyd oy nod ayeqo]s oinsour oun sua}go0 od { saguuo][y 
-ueyde suoljsonb sap sjquiasud | Ins SUdAOU s}Ivd9 S90 ap 
UUdAOUT BT SUOTNITeO snou ‘UIyU * { mod syuepuodsel09 
xneumndo spnorpaid saoIput so] Jo SOdIpUT soo aUA s}IROO 
([— *°"u) sop suudsdoul vy suopNoyeo snou ‘sing * { d9UUOT 
-[Hueyos uoysonb op sed jueuayuos ou soojq ({— Pu) 
sop unorvyo mod onuajgo jUdWAdANoaJo seao[a snyid 
BR] (7 ‘SX | A) SOIpuL,| Op MaTeA v] SUOUTULIO}Ep snou “IoT~NS 
-Iyed joIomjeur oseuuo]ueyse.p uejd un Jonjeas mog 

* X suonsonb soj soyno} mod yusursuRyNUIIs sopqesiyeol ono 
sed ou juaretmod saya ‘x4 souuo];HURYD9 UONsonb onbeyo 
Inod juowlsredgs sooumwiajap juos soyeurjdo dsorpul.p 
smageA soo sod “{ mod sosiyeo1 ono JUareLmMod nb 
SJHOIpsid sooIpul say Ins oIMotiadns suJOg oun JUassTUMO}; 
Z suoysonb soy nod (7‘x | X)7J ap sanojea (T— Pu) 
SOT ‘OO]q UN sUep oIOTUJOp 91190 DaAR JOINS yUoATOp Inb ‘x 
uonsonb ey e sadly soyjoo sed yuouuasdwi0s ou 7 suonsonb 
soy “A sed yueuagju0o ou soojq ({- Pu) xne sajjo 
oNUd,p dUN,| dp d]JonjUdAd UONR}OOTe | Inod ‘sagaaja snyd 
so] (Z°X | A)I Juoiposd corpur,p smojea soy juepgssod 7 
soguuo][queyse suotjsonb sanne ({— *°"w) say yUeANOD us 
A a9uuoyyWueyss uonsonb onbeyo mod yuaurosedas aryroads 
yso Jnoofqo owiomenb of mod joewuenb saqQWO UG 

‘(SANVHN ®] 9p uonejnunis red opmyg | suep 
p= P°y)*"y red soojq ap sIquIOU oa] SUDJOUDG “90]q 2 
suep sastwo suonsonb say yuastpsid inb suonsenb smorsnyd 
no oun s07q onbeyo ke Jo~aye (p yo yUoUFONbIso] sosIfol 
suonsonb say ooyq oulgur un ke sJOyaTye (¢ ‘oojq onbeyo e 
suorsonb op eso yuowaAneurxosdde siquiou un Joyaye (7 
‘oo7q [NOs uN ke d9UUOT]MWUeYDd UONsoNnb onbeyd JoydaF 
je (| :suoyjsonb sop uonepaye,] UajUaLIO UoNda0uU09 ap 
sJoolqo anenc) ‘7 UOTIeS PI Op JNQap Ne LOOP 389 |I SUTOD 
‘Soo]q SIOAIP & SoguUOT]WUeYOS suOTsonb soy yuUR}OIZe US 
S991 JOS JOIOLYeUL oseUUOT[HULYOS .p someuUONsonb so] 


sorteuuonsonb sap uondssu0d ap se1gtag [77 
$301q 


XNe SaguUO][HULYII SUOsoNb sap UOHeIIIIJW 7°7 


“u / 29 9|duuts sw0y 
ey eymparas ("g)in("g)"A (C"g) M1) onb yey np yuejnos 
-9P UOISSoIdxo SIOTUIOp ay99 ‘sonUTUOS saTqeieA soy Inod 

stu aN 
79) 2a 
30 ‘SoMeUIG SoTqQeLIeA soy nod 


(L) Ot 


sqo 


Cd) CP) "A (CP) s 


+ 
(9) (dg Cz‘ /x)) 4 - 1 sty ay dt 


e 


Ve CZ i ix 


jalouyew eHeuuolUeyDS,p SepoujEelW Sap UOHeNjeAs aut) 


ansdojejeo ne GqX-[00-ZI oN ‘epeuerd onbysneis 


suoud}qo snou “(¢) 39 (7) suep UOTNNSQGns sed 
osessyucidde p uojyueyse | op jueusAoid smoyeutsd soy 
yuesInponut us yo “("g) "1 sed o8essnuoidde .p uojnueyod | 
suep SO9ALIOP Sd] juxjousp uq ‘osessquoidde.p uoyn 
-ueys9 | SUBp soJURpuodssi0d souUdAOUT so] Jed soguIyso 
a9 UOp yUdANod jo UOT[HURYDE-snos op souUdAOU op 
SULIOF BP] SNOS JUSWITVS9 yUOS (Pp) SULP 1 MUDAIOJUT JURSTLY 
uoKouoy eI 30 (g)*".1 sopaLap soy “osessiqucidde.p uoj[n 
“UkYD9,] OP o]]Te} eT So “uw No ed) PAC™U / MU) (g) "A 
Jmu9}qo _~Inod osessnuaidde p uojjnueyoe,| op jueuoaosd 
("g)"A uoneuNse | ap juoUIoUUOTAYO9eI Jed souTxoidde 
ang yuoAnod nb ‘UoIssoISOI BP SJUdIOIJo0d sop soueLIeAOD 
-OOULLIvA Op soLneU eT jo ‘osessiuaidde.p uoHURYD9 | 
op yueusAoid “g suoTeUIsa soy OdAe ‘UOISsaIdOI ap syudTO 
-1JJ909 So] ‘oBessnuoidde ,p uoTTWULYD9 | B sa\sn[e UOISsaIsOI 
R] Soide p SOUIT}Sd dT[ONpIsoI oULLIVA PF] “0 Jed o9ulse 
ang ned nb ‘oO oljenpises souenea eT °({)A : Juanyoul 
sonouesed 39 syUSIOU saT ‘ofqIo UOyeindod swow Fe] op 
Insied e 911] Js asessuoidde .p uoyHueYsE | onb asayjodAy 
snos ‘x op soyuenbueul smayeA sop yuvUa}U0S xn90 suep onb 
Isule ‘{ Op SdadAJOSGO SINI[PA Sop yURUDJUOD suUOTTHURYOS 
-snos Sd] suep sjuepuodsali0o sonowered 39 syuOWOU 
So] JoWIse mod sgsiyn oo JUoANod asessnuoidde .p uo][n 
-ueyoe un pp yueUdAOId saowered sone Pp SUOTICUIT}SS Soy 49 
UO][HULYDI .p SJUSUOU Soy] ‘Presey ne jUsUOJOTJUS yUONbueU 
Jeloyeul = oseuUOTQUeyOS.p suejd sou suep sonadid 
sqjuenbueur sasuuop saj onb suosoddns snou onbsing 


asessyuoidde .p uoyWUeYyss un saadv_.p 
IAIIPIAd AMI[VA Ip IdIPUL| xp UOHVUIS| 9°1°Z 


“aNUIUOS }s9_{ IS 


i ey OU 


(s) [Egy it GQ) A Cg) i) + OH Od A 


}9 “oleurq ySo_{ IS 


(yt Da (0) 


(9g Czi;x)d - 0 eran eas 
(p) ae ony a a, 


14 °Vua1 


(zx Zu 


suoud}go 
snou ‘dg e yesa @ [eIouds onowered Moy jo ‘OUOPI,] 
eB gesa 3S UONOUOJ MI] ddAv ‘(CQYOZ) JOxUOYOS 39 JoyeYyOS 
ap (QT) uonenbs | juenbrydde uq ‘uonbueur x op smoyea 
sap sfonbsa] mod sjafns op uoriodoud ey ““g sed 39 sogAtigp 
sap mo9yooA a] (g)" 1 sed suoyuessidor ‘ueuojuIeyy 

; Z squUOTTHURYOS 
uonsonb ev] ap 39 YY sounutuo0s suonsonb sap souusAoul 
xne sajes9 JOS (g)’ ““ sagaigp say anb onbrydur ib 20 


: uosuyor je Hoz}ey ‘JayUeYoS ‘UeUyeUNYBey ‘sewoUuL  QPpZ 


andoyejeo ne F@q@X-[00-Z1 .N ‘BpeuRD sNbysneIsg 


pie (ipa ‘g)f ‘onunuod so _X Ig ‘omeUIg yso X puenb 
LEG. CZ Sx TE] I CZ ye 9) fa To 


I+ Vy =) 


GANS AVE WLA Sora NU jail 


301) 


10 


1+ ust 


(Ze Nut e XatS wlrrath tea) sell 


Oly 


9) Coes bi eA 


OULIOJ B Op Iso 99ALIOP PT ([+9) “7 T=l (gin 
red g ke sonfead g op ajuesoduioo jf x e woddes 
red o9ALgp es suojouap 49 (dC Ze il ieee au 
=(g)"u wog (ZT voHoos eT op p soLneoyrdurts 


asayjoday,| suojodder) (g)°"A 389 s0URLIeAOD-s0URLIeA 


op soLyeUl ej JUOp “YJ “mMaJeUIsSa UN dUUOP SagAJOSqO jUOS . 


Ss 


A op sinojea sop sjonbsay mod sjafns “uw say ms aapuoj 
J oP (6861 JPN 19 YseTPNDo) (Cour;qurestesA-isenb 
op no) sdURTqUIOSIeIA op UWINUWIxeW np UoneUINSd,T 
‘IOI SUOJASTTN snou onb ay]99 4s9 “(9 anIdeyo 
“SQ6I JOO ‘oTdtuoxo sed) sasepuos sop a09Y} eI op som 
UO][MURYOS puUeIS Ins syeyNsoI sop Ins onb tsure ‘11 yo S ap 
oIpJO Jouaid op JoJAB], Sp 919s Ud syuowoddoyjaAgp sop ins 
deseq jso Inb UoNeuTxoidde aya (‘aWUApPT,[ Isa 3 ‘odnod0 
snou mb seo oy sued) ‘Sdguta0U0d soTqelieA sap souudAOUl 
Sop 38 SSI] UONOUOJ 9UN 3S9 9}9;dUUIOD saguUOp op d[qudsud 
onbeyo mod oginoyeo uoneumss,| puenb ‘A, omp-e-3s0,9 
‘sqynduul saguuOp op SaTqUIdsUd So] AUD sOURLIRA PB] Op 
uoneulrxoidde sun satlop JO (QZ) JOYUSYIS 39 JOFeYOS 
"SOSNSIQUIOU JUOS SoT]Jo NbsIOy SoITeUTUOS SdTIOS9}e9 Ud soed 
-NOISdI 39 JUSANOd No ‘saeUIG so[qeleA sap Ied sagjuas 
-oido1 a9 JUdANed soyjoNprIAIpUT solOs9eo say ‘soguUOp 
-I0 sonbiios93v9 no sonbiios9ye9 sajqeliea sap mod saai0q 
-e[9 a9 JdANSd sapoyjJOU 39 Sd[9POUI sad op suUOTSUd}xXO 
Sop ‘Tor sed yUalos 9] OU soTjo,nb uslg ‘oyURISUOD Ysa “0 
‘Q]JONpIsal souelieA ey onb issne suosoddns snou ‘onunuos 
so f s[quuea ef Ig “({), WS] = (q)M “x ameurg agentes 
e] nod onbysiso] uoNouoy ve] ev 39 ‘Z=(4)N ‘x onuyUOD 
g[qeliea ve] Mod gnUSPI,] & a[e3d JSd UDI] Sp UOTOUOJ eT NO 


(GZ OX) We "(ZX 


‘gq snuuoout so.yowered sap puedap 

Inb 1 Ud] Sp UONOUOJ OUN dav OSITVIOUDS SIIVOUT] BTEpoUr 
un yins (7 ‘X) JuRyoRs X op Io] ve] onb suosoddng 

‘IsIoyo 939 ye ueTd UN nb yuesoddns uo “JatNonJed jaro 

-PU OSeUUOT[NULYS p ud uN ke He ev 191 saddoyaAap js 

mb gpe9 “A ooURLIRA BT Op UONeUUTxO1dde oun I1U9}90 .p 
gp}n yso JI “(Z “KX | A)J SOIPUL,| Op PNoTed 9 Joy|IOVy Nog 


“A op uoneuxoiddy ¢"1°7 


"y Jed 
aypoid uotqg elop yso 4 onbsind ‘aqueyiodum surtout 


SVC 


yso Xf ompoid mod sogudoidde 7 souUOT[QURYD9 
uonsonb vy] op UONdaI9s RI ‘UONeNIS 999 sup ‘STRUT 
‘7 SojuR\sol soguUOT]HURYdE SuOnsoNb soy o.4Ua UO 
-OUT|SIP opus op sed vIoy OU SOIPUT.] ‘X Op SOATIOIP 
-o1d JUSUIDYIOJ JUOS Y sounuwmuod suoysonb say ig ‘7 


1h, op 
juepuadgput yso (Z ‘xX | A)J oop “aw e soffouuON 
-rodoid quos “A yo “A “SA soouRLieA SOT "J 


> BION 


‘PRienr vol Hue. 
op JueucAoid saguUOp sop sasAjeUR so] JURINP IdIANODOL 
ono nod Xx IMs VOHPUIOJUI,| onb aos op ‘9Ag]9 4sSd 
A ep sanoipoid Moyea op so1pul | Wop 7 saguuoy[;HueYsE 
suonsonb sone p JoMJap 99 SUep 9}STXd [I ‘OOTG UN .p onjoxa 
yso Inb X{ sQUUOT]HURYD9 UONsenb onbeys Inod ‘anb oinsse 
J[qelisop joIoLneur ssevuuo][Hueyos.p uejd uy “x s9UUOT 
-[Hueyos uoysonb anne onbeyo op suusAow vy] op UOneU 
-s0,] @ Z s9UUOT]QHUeYOS UONsONb onbeyo op sjanjuUdA9 
uoNNgjUOS ev] Jonjeas Inod 9siyyn ano ynod soIpUl,T 

‘CSA = MA OIp-2-489 9) 
uonendut sues moyeunss e wodder sed uonesoowe 
oun sed sou sdnynur uoneynduit p soudsoid Ud Md}eUIT}SO | 
onb oy10s op 4no} np { Op sasiuo smayeA saz sed yuastpoid 
ou 7 1 ¥ puenb ¢ moea eyo ("A = “A onb 
0S op) {A op sasMUO soe soy yUoUOyeJIed yUasIpoid 
Z © X puenb | moyen e puaid (7 ‘KX | A)J SOIpUl.T 


duos IN _ ik IN 
(¢) eT =(Z'‘xX|A4)I 
>Z ~ X SuUep 
MNUdUOD UOHULIOJUI,| doIs9yUI yso Jonboy suep ‘aydytnur 
uoneyndut snos mojyeunss,, Jed saiAnodeI ysa mb RON 
yo SA aqua ye09,] ap UoNJOdo:d vy] sa gsodoid sorput, J 
“Su /(AA = SA egougp isa (4)a op 
uoTe NUT sues MdyeUITS,| Sp SoURLILA eT Spresey ne JOU 
-o1otua yuonbuewl x op soyuenbueur simoyea soy onb sored 
‘(XK ap sddAJasqo smMoyeA soy JUoWONbrun juesTyN us 4p 
qustuayne) uonendut suNoNe suRS SddAIOSqO SegUUOp sap 
Imied e ‘Xx ‘aguuO]]HUeYSS UONsenb oun ,p sodLIvATUN SomeU 
-UWIOS SINVA Sp ‘SddBOJOUI JUDWUDTJoNJUDA sTeU ‘soTduIIs 
SINDJCUISS sap IUI}qO Pp sTqIssod 4sa ]I ‘sjoIOLNeU sUOTTH 
-uvyod p soidne soljjionsar yUOS saguuOp sap onbsi0T 


doIpul | ep UOHMUHoOd Pr? 


(P66 SUD (9°¢ UOTIAS */ 86] UlGny) JUds.19NAU0N 
ySo (Z) DURGA PB] Op Mayeusd,| aonb aJ0s ap ‘sojoyduros 
soquuop eB s]OpowW a] daAe d[qQNedUIOD jso UOTeyNduII,p 
g]9pour aj onb gsodxa,] ap suo] ne yno} suosoddns snon 


=f 


aoc Ww att 
(Z) “(a -—') XW Mas FA 
Ww 


900Z aiquwas—ap ‘ajanbuse.p senbiuyoe | 


duoo 


Joe OL) n=) oF A ONUOD 
yue}d SUMUIOD s9}Ie) oN nod YX op doURTIeA ke] sjonbsoy 
Inod ‘suoj[yueyoS spueIs op sed o] sued ‘soyndult soguuop 
op sofquiosud soy] OUD dOULLIeA PI Op UoONeUISd oun 
‘SUISTXNP 9] 39 Sjo[duIOD sagUUOP So] ddAv }IeIPUATIGO UO] 
onb souelivA ve] Op UONPUITISO oUN 4Sd OULD} Jorueid 9] No 


(1) ¢duut duioo 


A er a 


yso “(['¢ UONSIS “/ 86) UIQnyY op doURLIRA eT Op oJUvINOD 
O[NULIOJ B] Op JURAIOS 9S Ud ‘7 JO YX JUSTIN Ud Sagoo JOS 
suoneindut soy onbsioy 4 op soueliva x] op moyeurss Uy 


[+°"u=t T=! l=! 
le 1 OR ee th Fotis "Wpede/t 
AO COIL C4 eee <ul 
u Uu 


SITP-R-489 9 

‘(anne | & Jojdwos soguUOp op e[quiosua uN.p sed yuOLIeA 

au mb) “Pu “Far “y= ‘x soparasgo simajea sap yo “uv 

eo er 4 Sy 7 "7 sogyndut simoyea soy dae yo]duI0S 

sosuuop op syquiosua _/ 9] soide.p sajnoyeo ouUdAOUW PB] 4S9 
y} 3 re 4 7) 


‘€ ‘suonendun .p siquiou 9] 89 py “Uorssoidxa 999 sueq 


co<— 


=f 
afl = 
a < AN wy = 4 


ged ‘suoneyndunp rayut 
siquiou un.p ssoyjodAy.| snos ‘oumtxoidde jso (X4)q op 
‘A ‘gydnynur uoneynduit | Ins spuoj Ind}ewysd uA) ‘JE1OLyeU 
uoyNueYyoS,| eB conbrdde ojdnjnur uonendun sed (x)q 
JOINS Pp INA Ud T[qQRId 4SO SATIOIPSId IMa[eA Op dIPUL,T 


a[dyjnu uonendurr| ims sgseq uoHeMIsy ¢°1°Z 


‘soyeuoleu sojonbus say suep Jouuso e sanouresed sap 
yrednyd ey nod ayenbape ono pesAop uoneutxoidde 
aneg ‘ayuoursne “uw puenb juejsuoo so 
one1 aj onb jo puess yso ™'u onb suosoddns snou 
uoAIns Inb suoneuntxoidde soy JOALISp op onA UW'S 
UOTVIOPISUOD Ud slid JOIOLNvU aseUuUOTIN 
-ueyod p sued soy sno} mod oyeysyes ysa asayjod 
-Ay ono) ‘presey ne yuoWoJOWUS JUenbueW soguUOp 
op dUUISTURdDSU 9] UOTAS sayURNbuLU ssguUOp sop jINp 
-old Jorolnew osvuuo{HueYyos | onb suosoddns snoN ‘py 
“QOIPUL | Sp souRUUOJIod 
R] JUDWID|QeISPISUOS BIINPSI UOISIODId BT Op dJUdI9YOO 
uoneujsoms oun.nb sed suosuad ou snou ‘neo 
-nou oq ‘asessnuaidde .p uoyyueyos J suep onb tsure 
JoIOLNLUT UOTT{HULYOS | suep o]duNIs oTOJegTe OSeUUO] 
-[QHueyos red souuoNo9]9s 939 JUO syURpUOoda say onb 
suosoddns snou ‘adrpul | op siMa[BA Sap [Ngpeo ap NOG =“ 
“UNUUUOD steIq UN Jed o1fIPOU 
sed vias ou janba] ‘suoysonb sap yuoUWasse]d 9] ]Qu}9 


uf Pu 


ansojeyeo nv {dX-100-C1 oN “epeury onbusyeyg 


Inod yuowosredioutid gsipyn yso soIpUl.| ‘oouUOTH 
-ueyo9 uoysonb onbeyds sod owe a] yOUIDA 
-eulrxoldde ono yerlasp sanoipoid ImojeA ey suep 
anbryeuigsds sterq yno} onb oz10s ap ‘sIoy ap siquuiou 
oUIQUI a] sasod eios 7 uUoNsonb onbeyo ‘yoJO:ms 
oq “Z sgqeuea simoisnjd juesyN sogueannui 
SOpoyJoU op ople] v ddLOD a9 ynod UOTPUMMSAIS 
op osued 99 ‘({)q op SUOneUISA sop UOTRIOT[OWIe | 
mod 7 op g[NN,J sp UvoHeUMsoms oun ke Nd] 
Jouuop juassind sasayjodAy soo onb usrg ‘aydu09 ua 
sud sed jso.U (Jo1ornew oseuuoTTHUeYSE | ed sage10 
sed yuos ou tnb soyuenbueur sasuuop sap ‘alIp-e-3S9 .9) 
sonagid uou soyuenbueul sasuuop ap s0UeLIN990 | 
‘ano uq ‘souUOT[WUeYDa UONsoNb oun Issne }sd 
Z onb sored ‘x ompaid ap syqissod simofno} sed vias 
ou qt ‘onbnesd ua nb slope “aArtasqo JUSUISIONUS 1SO 7 
guuoy]HUeYSS Indjorpaid onbeyo aonb suosoddns snoN ‘7 
“sjnoyeo ap srquuou puess 
snjd dnoonveq un jeloyIssooou sieu ‘soyqryquuas 
sqjeuidoid sop ‘adioutid us 4rermpoid sssuuoynueyos 
suonsonb anne .p o3dur09 yuRUs} soyjonsed suoneya09 
So] IMs o9seq sOLIeANTNUT sYydoidde suE, ‘sOVOTS 
Joronjeur ued un pomber a] SUID ‘syUDIOTJIP Soo[q 
sop e@ suoysonb sao Jonqinje.p sojojja,s uoMoayye .p 
MUYWOSTe | ‘oyjonynur UOHR[aOS syOJ oun jURIUAS 
-oid suoysonb smorsnjd oystxo ]I.S “XX sounuiwi0s 
suoysonb xne ynole] op sso, WOWOdT[ONprArpuT 
Qopisuod yso_ 7 QUUOT[HUeYOS IMajoIpsid onbeyD | 


"Sa[qissod [OIoLyeUl os eUUOT[HULYDO .p suRTd sop 
UOHLNILAD | JUSWS|[GISUAS dID}Te oT[9 nb yUonbrpur sosreyuSU 
-g[ddns sopnja sop Is soutuiyS no oryqreyye ong ynod aso} 
-odAy ojno]y, ‘sa9uuop sop sayuonbesqns sasAjeue soy suep 
UOU SIBU ‘[NOTVd 99 JURINP SOOSI[IWN JOS SoT[q “SOIPUT.] Op 
[noes oy Joyiydumts mod soyrey yUos sosoyjodAy smorsnig 


sodtajyeogiyduns sasgyyodAHE 7 1'Z 


(DA 
70 (X)q Jed sogjousp yuos joIOLneU ssvuUOTHURYOS | Jed 


d9sIA UONeINdod ey suep X op doURLIeA YY 10 DoURIOdSO,T 
“SUOTILAIOSQO .p 


S 30} Gensler (clletemeate 


[@}0} SquoU 9] 3sS9 WENOD AT. 
red sogjousp juej9 X op simoyea soy JudAIns juonbueuw 
X ap smayea say sjonbsoy mod sjafns Sw soy anb yo ‘x 
“-- ly Jed sagjousp juej}9 X op SIMITeA soy “IOOUSUTUIODS 
Inod sgisuINUS JUSIOS X dP SO9AIOSGO SINI[PA Sop d)STXd 
[Jt sjenbsay mod syofns “Pu saz onb ox10s 9]][9} ap sasseyo 
29 JOAIOp syolns soy ‘ayqissod Jo1oLneUL osevUUOT]HULYDE _p 
uvjd un suep ‘ouoq ‘soyuenbueul soouuOp sop sUWIU0S 
JoJgpisuos jnod uo J aonb 90 9919 JaIOLyeU os eUUOT[MULYIE .P 
uejd un 4ney snjd suuonuoW suoAR,] snou sUTUIOD 


TU 4 840), — 


STU 


jaloujyew SPHeuuo||iJUeYOS,p SepoUujeW Sep UOH}eN|eAs aU : UOSUYOL je HOZ}ey ‘“YayUsYyoS ‘ueUyeUNYBey ‘sewouL ypHyzZ 


andojeyeo ne GqX-[00-ZI oN ‘epeueD snbysneig 


‘X oitpoid inod sgsiyyn souuo][HUeYS9 UONsonb 
aun, <7. IoesouMULIOD AsuUOnSsOnD. So] e"(- ar a ay.) =a, 
‘qupeid ano yueAnod s9uuo]{HURYDE UOTsonb oun ‘Xx OS 


PDLyQVU ssvUUOT[WQULYDII Pp 
suvyd sa] anod oareurmnyaad uonejoN [TZ 


dATIIpoAd IMIJ{VA Ip VIPUL [°C 


‘OATOIPOI MIVA op dOIpUT | Sade .p sooyq xne soguUOT[N 
-ueyod suorsonb sap uoneofe | Inod suyyLoOs[e UN SUOALIO 
-9p snou ‘7°Z UoTOes PT eB YUoUOUOTxneq ‘adessnuaidde .p 
uo][WUeYSS UN,p Jed vB SOIPUI,| Op SIMNITvA Sop UOT}LUISO ,.P 
SopoyJoul sop Issne suojuasoid snoN ‘sounuUUOS suonsonb 
Sop UOISNJOUT.| B JUOWAT[IUUONIPUOS UOTSIOQId op JHeIoI 
ures onb jue} ud samMsoU jyuRIO SATIOIPSId gITQN,| ‘aouUO] 
-[nueyss uoysenb oyne onbeyo sed yuows}d0I00 oyIpoid 
yso oouUOTTHUeYDS UOTsonb onbeyo ajenbe, suep omsou 
PB] JOUTWIOJOp op jURYOUWIEd soIpUI UN SUOTNUWOJ snou ‘{°Z 
UOTOIS PJ & JUSIUDIONUSIJ “S}QJOA XNop opJodurod uoHRIogeyS 
a0 ‘JHoolqo 390 sIpuloye.p oNA Ud spoyjsw ouN,p 
uoneiogr]s,| Ins oJ0d jms mb uorssnosip eT] ‘saguuop sap 
ascjeue | op odvjo.] & onjoxo uonsonb ve] op jofns ne uoryeur 
-IOJUL,| SP JWOWIDIANODAI JI SPITTIORF evIIO fonjoxd uoNsonb 
RB] op soanorpoid yuos ‘sounumu0s suonsanb say daae sod 
-noiso1 ‘nb oo]q a] SUeP SosNyOUT saguUOT[MURYDE suOTsoNnb 
SOP 9}STXO [I ‘OOTG UN,p onjoxd souUOTTHUeYDE UOTysonb 9yno} 
Inod ‘aonb uodseyj ap sooyq se] oyUa saduUOT]HUeYDS suOsonb 
So] wyedor joloMneul oseuuoTHURYsE,p uvjd uoqg up 

‘sommeuuonsonb sa] sno} 
suep Jams} JURADP SUNUIUOD UOT}soNb oun SUIS d9USISEp 
a9 no ‘ameuuoTsonb un,p snyd suep osnjour ano yWeLmMod 
19-a]]99 ‘Uonsonb sun mod seyreynos jso uOrsIOoId opueIs 
snjd op uoljeusa oun Ig ‘JOIOLNeU aseUUOTTHURYDS .p 
suvjd soy sno, mod samnoyesijgo sed yuos ou sonbysi 
-9)081e9 soo onb yuepusddss suojoN ‘adA} ougU ap suonsonb 
so] nod wuorstogid ow eT Issne ynpoid oq ‘opme,.] 
eB sjuedionsed soy sno} mod ssuodas ap neopsej np onbryuept 
UOHONPSI UN SUUOP MoNSUO] SUI ap sooTq op UOTES 
-]QN J ‘07g [Nas uN v dONQLIe }so sOUUOTTHULYDE UOTsoNb 
onbeyo jo ‘ajes9 oi]Ie} op yuouoAneurxoidde yuos soojq 
Sd] ‘IOI BalOgela spoyjou ev] sueq ‘(Pp Wused Z op suosieu 
-IQUIOD) 1NO} Ud XIS o}STxO Ud [I.nb ozIOs ap ‘(sounUTWOS 
suonsonb say onb tsure) sooyq xnoap yuoUOS ameuUONsenb 
onbeyo 30 ‘soojq oenb uo soniedo1 yuos saguuo]HUeYoS 
suonsonb say ‘¢ UOTDOS ¥] B SUOJONOSIP snou JUOP SANVHN. 
Re] ms yueyod opnjya., suep ‘ofduioxo Jeg ‘oiquioU md] 
}0 someuUOsonb sop monsuo] ev] JUOUTUIO}Sp dIQUIOU M9] 49 
SdO[G Sop IIe} VT “(S66 BZZUH Jo ueyyeuNysey) soouuoy 
-[nueys9 suolsonb ap sooyq simorisnjd no xnep jueyquuosse 
Ud SddJO JUOS [OIOLNRUL oseUUOTHULYDS,p someUUONsonNb 
Sop Jo ‘Sdo]q Ud saTedal JUOS sogUUOT[WURYDE suOT}soNb so] 
‘Q[GISSod }IOS SoTqeLIeA INU soTJOUUOTNSONpIg suOTeIOOSse 
S93] S9]NO} op d}OoNp UOTJeUISS,, onb mod ‘ameuUoNsonb 


Cve 


un suep amsy sosuuoyyueyse suorjsonb op syqissod ousted 
onbeyo onb Jomsse.s op uypY ‘sosuUOT]WUReYOS suoNsonb 
sop uol}estUeSIO | mod jeULIOJ UN IIsIoyo Issne yey I] 
‘asessquoidde .p uolHueYyse UN.p spre | 
® SUINSd JSO SAQUUOT]HURYDE SUOT|soNb sap sinoayeA So] orIpoid 
ap MoAnod oJ ‘saguuoyyueyse suonsanb sap uoyoipeid vy] 
Iod sounumos suonsonb sop sy]yN | sp o3duut09 yuouaTes9 
yuo inb o:msoaut oun Ins dsoda1 saguUOT[HURYDS suOKsonb 
sop uonniedal op spoyjour ey onb suooea snou ‘juepusdadg 
‘sagquUOTOEIIS 939 elop JUO SaroTUJOp soo onb suosoddns snou 
‘souNUILUOD suolsonb say Istoyd ye uo. onb soide soseu 
-uoysonb sa] ayue sopuuoT]HUeYoS suoNsonb soy mredo1 op 
UOSE] LI AMS TOT STU JURID JUDDNR "JT ‘SOdUUOT[WURYDS SUOTsoNnb 
Sop JULIO SUTUTOD Neopey UN ayUasoIdar (NO) 39 dsNd}NOd 4sa 
uoneNSIUIUUpe | JOP suoNsonb sop JoUSISOp op xnosvURAL 
ane jnod [I Jeo UOHeIopisuod Ud ospuoid e syUOUIT9 sop 
Issne yUOS Uoysonb oun ve so1d0sse asuodal op Nvopsey 9] 19 
yoo do] ‘UU ‘oteUUONsoNb 9] sURp SasnjoUT soquUOT]HURYDE 
suonsonb xne saguriquios sounumuuo0d suonsonb soy solide .p 
soiodnoe1 ono ossind omeuuoysonb un,p sanjoxo jos 
Inb saguuo]{WURYyde suoNsonb soy ins UOTeUIOJUI | onb uye 
‘soquuoy[HuRYyos suolsonb op siquiou puis un.p soanorpoid 
quos nb sounwuros suonsonb sop JouUOMOS[9S op syn 
ySo [I ‘anno Uq ‘sosUUOTTHURYOS suONsoNb sUILOD sSoIsIOYo 
ano yuoAnod souryJodut spueis sulour op sojjao onb sipur} 
‘soUNUITUIOD ~suoTsoNnb sop sUIWOD sagylen a9 JUOTeIAOp 
‘SOSTUITXPLU O19 JOP smoyeUIsd suTeyIOO op uUoTsIooId 
RB] Sorjonbsa] mod ‘sgjo suonsonb sa] ‘suonsonb sop sanryal 
souryioduit | e@ yuenb suoneiapisuos sanne .p Ins 39 spuoy ap 
yuowiosnf un Ins yURSEG 9S Ud SOSUUONOII9S JUOS SOUNUTUOD 
suonsonb soy GuowaTjanyIqey{ ‘sosteuuONsonb sureyisd suep 
aonb sasnjout juores ou nb saguuo];Queyos suolsonb sop 
SUILUOD sogjten yWOJOs suoysonb soyjonb 39 someuuoysonb 
Sd] Sno} suBpP sosnjoUuI yWOJEs Inb sounut0s suonsonb 
Sop UIUOD sadIspIsSUOd yUOJOS suOnsonb soaqjonb Japroap 
ney [I orOLQeuU uOTTHUeYSS UN .p UONdddU09 Fe] Ap SIOT 
‘sjuepuodal op uoT]HURYDSE UN kB sdasod ane 
B SODUSOp suoTsonb ap s[quasUd-snos UN yURUDJUOS UNdeYd 
‘SIOLyeWU oseUUOT[HURYDS,p someUUOySONb op uoNdaou09 
oP Spoyj}oW uN ,p UOHeIOge]I,| WLIO9p UOTJOOS ayUOSoId BT 


PDL osvUuUOT[QUeYII,p 
soltvuuoysonb op uoyndasu0) °7 


‘py UOT]IOIS BI B UOISSNOsIp oun Jed 
NOUS 9s spoTe | “UBUY “SANVHN BI Ms sppuoj spni9,| 9p 
S}RINSOI Soy Jo OsvUUOTTHULYSE ,p ud Z| WOOP ¢ MOTIONS BT 
‘OIOLNeU oSeUUOTTHULYOE Pp soueuUONsonb ap uoydsou09 ap 
Spoyjoul ef IS9p 7 VOSS BT TI] SHNVHN ¥I 9p SeguuOp 
So] Ins juRyod uoNrfnus red opnjye oun kv ddRIS soNTeAd 
qyuos odyjnw uonendut.p sopoyjoul soy jo JURINsoI ud 
9] sind “(] SENVHN) SANVHN elwerxnap ev] ap jueuaroud 


900Z eiquisdep ‘ajenbuae.p senbiuyoo] 


sajoyid sssuuop sap e sanbrjdde jso areuuonsonb np uondas 
-U09 Op dpoyJOU vl ‘AoURTQUIOSIeIA op IONOS Jeg ‘soyuRsod 
-U09 sojdyynuu op onb isure ‘syuouoUTeyoUs XNoIQUIOU sd] 
qUdaTJoI onb 39 ‘suoysanb say aUS soxo{duio0s soyjomyonys 
soouvpuodap sop sed s9stigjovieo yso Inb ‘SGNVHN e®] onb 
so]jo} sojonbus sop mod joromneul sseuuo]HUeYsE .p suvjd op 
SITIQestey LT JOIPNS.p JURSsoIOyUT jso [J ‘sonbisojorq syusu 
-dAgaid ap oiojelogery ud asdyeue.] 30 d[IQOU UoWeXd.p 
oUd0 UN SUeP [BOIPSU UdIUeXd UN ‘soseUSUT sop soIqUISUT 
So] Ins omeuuonsonb un,p uodsow ne sjuepuods1 sop 
soidne saguuop op 9yjuenb opueis oun Iplonoes op youuod 
‘Sopollod SasIOAIp op SMOd ne sIoF smartsnyd saj9da1 939 eB nb 
gyessoasue.y ojonbus oun “SqNVHN v7 ‘(wy ‘soueyuysyou 
/AOS Opa MMM//:dQY) SHON 2 Jed sesiyeos oyeuoneu uon 
-ejndod ev] op soareyuasaides sayonbus sasnorquiou sop oun] 
‘(SHNVHN) Aosmg uoneunuexg uonLNNN pue yyeoH 
JeuoneN ke] op yueusaosd soguUOp sap Ins juRyIod opmo 
OUNP SIPLd d] SUP DONTeAD jSd JOFOLNeU dseUUOT[HURYII .p 
apoyo ey ‘omeuuonsonb np uondsouod ey] JaXndde 
Iod 9st] so71d UoTTHUeYDE UN Pp No ja[duw09 oMeUUONsonb 
un.p omMoLigue uoneNsUIUUpe.| op IMudAoId ynod JoTMIAp 
a9 ‘asesstucidde.p uoyHueysa un,p osodsip uo. onb 
asoddns spoyjoul eT ‘JOIOLMeU dseUuUOT[HULYOS | B NIMOdaI 
sed }IVAR U UO] IS ST[[IONDOI 939 Jee Inb sanjoxea suoysonb 
So] INS UONLUIOJUT,] JOIANODAI op syqissod jos jl ‘oydy 
-[nu uonenduUT.| Ins sagpuoy soyUonbesqns sosAjeue sop 
S10] ‘aonb 9110s ap ‘sanyoxe suolsonb sap saanorpoid yuos mb 
suolsonb sop suusiduros unoeyo onb uosey aj] ap snduos 
quOS someuUoNsonb say ‘suoysanb op syusWoUTeyous sop 
O}STXO [I NO sUOTJeNAIS soy stiduod A ‘soxaTdwu0d suOTyIPUOS 
sop suep oonbijdde ana jnod spoyjou ey] ‘sjuepuodar 
ap omojyegye uoTTHUeYSS UN ke sogsod oNQ yURADP suOsonNb 
Sop s[QUIDSUd-sNOS UN JURUDJUOS UNoRYO ‘JOIOLNeU oSeUUO] 
-[Queyos .p sareuuoNsonb op uondaou0s ap spoyjeut oun .p 
uOneNeAd,| 30 JUIOd ne dSTUU RI ILIOSp apoE yUasoid a] 
‘d9IplNyd 939 BU SUOT]SANb so] dD SayUOIOYUT SUONRIDOSSE 
So] jyueyoydxo §=jolormjeu oseuUol[HUeYyoS,p suxyd op 
uoles10 op sydoidde ounone ‘aus P| INs speIoUas sTeUOTIeU 
ajyonbus oun mod saquUOp sp 9}00]]09 kT OP a}xa}U0D J] 
suep ‘onuos Jeg (ZQOZ NZIWUIYS jo SUI] ‘osoy ‘UBO;UDH 
‘IoyuoyoS) syuepuodsr sop suIdIXIS UN UOAUS,p soidne 
onua}qo 919 & UONeULIOJUT | ‘oysT] onbeyo mod 44a sojsI] xIs US 
sniedo1 939 yUO sonbruosyo sues op sowlatqoid sa] ‘aygnbus 
911090 sue] "UONUDADIg PUL [ONUOD dSvaSIC] JO} SJoJUdD sop 
(SHON) SOUSHRIS UIeOH JOj JqUaD [euoneN 9 Jed sgst[vos 
ADAING MOIAIOUT YIYeOH [euONneN eI SULP /G6] JUeAL 
9sI]IN 99 B OLOINeUL oseUUOTTHULYDE.p osUOs UN ‘oTNO 
uq “(EL6] JoYeUeoys) sesuidenus sap opme| 19 “(€66I 
UYJUDH 19 OLMVARN) STUP-S}eIq Sop JUOWIOSUDDOY ZT ‘(9007 
UOT 19 UPWIOSNOH] ‘CS66] QIZZLID) jo ueyeUNYsey ‘P66 
[ley 10 904 “[JoLeD “Japjoyor A) aus ek] Op oUTeWIOp 2] SULpP 
dOINYIOI PI “(L6G SPUIO], 19 10397 °7GH6] YOIMZ 10 UOJVag 


onsojeye7o ne {qX-100-TI .N ‘epeurg onbysyeis 


‘LL6 UOIUITJEM 19 YIUIOMS) somejoos sinboe sop uon 
-PEN[PAD,] OULD ‘SddURISUODIIO SdSIOAIP sup d9IO[dxa no 
sonbrydde 939 & joroLneul oseuuO][HURYsE | op ayooldde J 
‘JOIOLNRU OS vUUOT[HULYDS .p suL]d op yuvUdAOId 
soguuop xne soonbijdde 30 yurod ne sas ong yuoAnod 
‘asepuos op ued un mms sogpuoj onb Isure syopour un sms 
sogpuoy ‘ofdnynur uoneyndunt., onb uoneunjsa.,p sopoyjoul 
soyne.p ‘sulowuRaN ‘sopnjo sop ywednyd ef justqio onb 
sonoueied xnoiquiou sap undeYyd mod sapoyjour soyjoaAnou 
ap sed oyISsa09U dU aT]O (¢ 30 SJURISTXO S]OIDISO] op UaAoUT 
ne sguowgdut ang ynod uoneyndu | (7 ‘asepuos op urjd 
9] XNOIW 9] yZeUUOD Inb ajonbud.p owsTULSIO | Jed sloy aTNas 
aun o9yndaxe aE jnod soxafdu0d sodLIeAN[NU sopoyysu 
ap uoneordde | (7 : uonenzs 3300 & 99jdepe uUdIq js9 aT[a nb 
gored ‘ofdnynur uonemndut., ms suonusdu0d snou snon 
"sonjoxe yuos nb sayjao op jofns ne UONeULIOJUI | JoIANODeL 
Inod sasnjout suonsanb soy JastjyN,p s]qIssod 4so [1 ‘oydnynu 
uoneyndul | suep ‘sioye ‘sagsod sed yuos my ou mb suoysonb 
sop soanoipeid yuotos yuepuodal anbeys e saasod suonsonb 
soy onb uodey a][9} ap nduod 949 & [OIOLNeU UOTTHURYDE,] IS 
‘Woloms oq ‘osepuos Jed ajonbua.p sajyajduios saauuop sep 
ashjeue p plepueys sopoyjoul soy Jonbrydde ynad aysAyeur | 
‘sojdnjnuu §=suoneyndut sop uoneoo vi soidenb soled 
JOIOLNeUT UOTTHURYOS UN.p jURUDdAOId sodUUOP so] JasATeUR 
Inod juK}U9} so ‘sayuenbuew smoyeA sop juRJUasoid soquUOp 
So] Joye mod yulod ne asi ayuayeadjod oysoidde oun 
‘(Z86] Ulqny) sdninu uoHendul,.| e sModel aT ‘asepuos 
op urd np sorqelieA sop ms JUOWOT[oNJUDAN gpuo}y NUUOD 
aysTIqegoid sUIsTURDSU UN,P yeI[NSOI a] Jos satjo nbsind 
‘(9/61 Ulgny) presey ne yUoWOJONUS JUuenbuRW SLOW 
no ‘presey ne yuenbueur add} op ‘soyuenbueul soguuop sap 
SUILUOD JO19pIsuod jnod uo J onb 90 9919 joIOLNeur aseuUOTIN 
-ueyod ,p ueyd un .p seo oy suep yuepuodas onbeyo e ajonbuo || 
ap suonsonb sap syquiasud-snos un nb Jasod ou ap yey aT 
‘soouuo]ueyse suonsonb op siquiou 
pueis un,p soanoipsid pos ‘soyueyiodun yuoworornonsed 
los JUOS souNUTUOD suONsonb sUIUOD soIsIoyd suoKsonb 
Soy] ‘JuoWaTONIIQeH ‘syjuepuods1 op spquiasue-snos un ve Nb 
sagsod yuos ou (« saguUOT]HURYDE » SuoTJsonb Tor sagjadde) 
sone p onb spur} ‘syuepuods1 say sno} e sogsod juos 
(« sounuuoS »» suonsonb tor sagjadde) suonsanb soureysso 
Jolomyeur oseuUuoTueyoS.p suvjd xnoiquiou op sued 
‘a39]du09 uoNnendod x] Ins saguuOp op a]jonydaou09 sole 
oun.p med e « souUO][HURYOS » sone Say Jo SUN So] JOS 
(souuojod) suonsenb soq jo (Soust]) syuepuodas soy] onb s9gpt.] 
JURII[JOI UOISSaIdxa sIOTWJOp 900 “« [OIOLNeUL oseUUOTIN 
-ueyoe »> .p sued no « spulos omeuuorjsonb » e sued sgfodde 
quos odA} 90 op sameuuoNsonb sap ins saseq ojonbuo.p 
suejd soy ‘syuepuodsi sop suteyioo e sulour ne ogsod 
ylos uonsonb onbeyo onb uye ‘syuepuodss op sojquiosus 
-snos sjudlayip e saystunupe juos (sway) suonsonb 
Op Sd]QUIAsUd-sNOS sSJUSIYIP So] “soyquasud-snos sod op 


jaloujyew eHeuuo||iJUeYOS,p SepouJEeW Sap UOHeENjeAs aU) : UOSUYOL }e Yozjey “WyUsUdS ‘ueUyeUNYUHeY ‘sewoyuL ZPHZ 


“AOS OpoM)uosuYOl]o : JaLUNOD “—\-'F ‘78LOT GW ‘AT[ASHRAH ‘peoy opejoL [EE ‘WoNUsAsdIg pure joNUOD aseasiq 
IOJ SIajuaD ‘sonsieIg YIeOH JO JoUaD yeuoneN ‘sAdang uoNeuMeX| ‘UONLINN pue yyyeoH JO UOISsIAIG ‘UOsUYyOr “TJ PIOJJID ‘aos opoM)yyozie yu 
:yaNOD “A-"A ‘Z8LOT AW ‘A[IAsSHUVAH “‘peoy opejoL [TEE “UONUAdIg pue [OMUOD ssvasIq] JOJ SIOJUID ‘soNsHeIg YIPoH OJ JojUD yeuoneN 
‘AS0TOpoyIOW pue yorvasay JO sJO Jjozjey ‘¢ UOIAPY ‘AOS'opo@)1ayUoYsu : [oLUINOD ‘N-"d “78L07 GW ‘oy[IAsneAy “peoy opsjol [TEE ‘UoNUsAcIg 
pue [ONUOD asvasiq IO} s19jUdD ‘soNsHeIS YIYRIH JO} JoJUID [euoyeN ‘ASo;opoyIsJJ PUL YOIRasoy JO sdyJO “JoyUoYOS joruryeN ‘npo yorun@)nyse19} 
:PPLINOD ‘A-A ‘OOI8bh IN “loqry uuy ‘UeSiyoI, Jo AjIsIOATUA, “YOIRasoYy [eINOS JOJ ojNYsU] pu soNsHeisolg Jo JUuoUIedsg ‘uLYjeUNYSeY 
“YF OIOTJOAIL], “W109 OOYRAM) HHS PULOYIUS : fetnoD “N-"A ‘Cpp90 LO ‘UOsIpey ‘OALIG] OYeT UWlesIq [9 “OUT ‘YOIvasoy soLjowejed ‘seMOYy] [eeN ‘| 


un | &,nb opuodal ou op yuepuodal onbeyo e Jopueurap ev 30 
Sd]quiasud-snos Ud ajonbud oun ,.p suonsonb soy yuowUspnd 
Jadnoisal & d}sISUOD dsUOdaI Op NRopIR] 9] JURITLUTT Ud No} 
OMBSSIDOU UONLUNOJUT.| IUd}GO.p JonJUsAd UdAOWW UL) 
‘sayonbua 
Sop UONRST[VII BT Op NOD 9] N.199v JUO S9ad]9 asUOddI op xne} 
SO] ITUSJUTRUT Op ONA Ud s}LOJJo xne onsn{UOd syIdAnod sjofns 
op ouIlUeS ev] Op JUOWOSSIsIe[D,] ‘oNNO U_ ‘sojo[dwOOUT 
sosuuOp sop sasdy[euR soy suep a}duo9 us sostid sed juos 
ou sjuepuoda. say 39 syuepuods-uoU say oud sonbiyeUI9}SAs 
SOOUIIOJJIP SOJ IS ‘stTeIG SJ 9.NLOIDOR Issne ynod aT[q ‘oyonbua .p 
SOSUUOP Sd] INS sogpuo} SUOTFBUIT}SA Sap UOISIOgId eI dIINpoI 
ap onbsti asuodai ap xne} sap assieq ayja9g ‘asuoda1 ap 
xN¥] Sop ddAJOsSqgoO UOTNUTUIP eT e yUONGLUOS INnb smoyoR] 


Jed ajgnbuo ‘apulos omeuuonsonb ‘asuodsr op neopiey ‘oydnjnw uonendul ‘sayuenbueuw soguuog 


sop un] o.49 WeLMod ssuods op Neopsey Np JULI[NSEJ JUOUUAS 
-slolooe ‘TJ ‘sue sop [If ne quoUIsNe JUDUIOTeIDNUNS JUO ‘sonA 
-aud sap Inonsuo] ey yUonbgsuod sed ya ‘sayonbud,p sues 
90 Jed syoAnod sjofns op oiquiou oY] ‘aqUuoUTIOd uoneU 
-JOJUI | JURSSTULMOF Ud JNO} Sa[qvuUOSTeI spnj}o[duod ouN_/P 39 
ININSUOT 9UN Pp 9.99 dIIP-k-}S9 9 ‘syUdLMIUOD s}NOElgo xnop 
JOlIOUOd JUSATOP jo ‘soMeUUONSoNb op udAou ne saduUOp 
Op aJoYyd9 spueIs ev Qoo]Joo oun 30 s[euoHeU uoNendod 
R] op syyejuasoidar saystiqeqoid suoj;Hueyos sop nol ua 
JUSOU sojgnbus sao UdANOS ‘soUTeUIOp XNoIQUIOU ap suUep 
sonbnijod sap sojqesuodsa sa] 39 SmMoyoJayo soy Jed soogstyyn 
yuos osepuos sed sojyonbua,p jueusAoid saguuOp sa] 


uoHINpo.nUy «*T 


‘osepuos 
: S9J9 SJO| 


“sqjonbus samyny op SIO] 


JoloLneu oseuuo][HUeYE .p suejd sop suep simpout.p stidoidde jreJes [I.nb suoynsonb xne yuenb sonbyesd suonepuewmuoseal 
sop ole} op jounlod 39 oxayduioo omjonys e ayues eB] INS oeuOTeU aJonbua spueIs oun e sonbijdde ane yned ayoosdde | 
onb anuowsp opnje,J “UOHUdAdIg pUe JONUOD ISvdSIC] IO} SIOJUSD Sap SoNsHeIG YIeOH JO} JqjUaD yeuoNRN a] sed 
sogsi[eal oyeuoneu UuoNendod ve] op soaneosoidal aystpIqeqoid oseuuoT[HueYse Jed sajgnbus sasnozquiou sop oun] ‘AdA.NS 
uOTeUTWeXY UOLYNN pue yYyeoxY [eUOTeN ke] op yURUdAOId sagUUOp op UdAOW Ne senyeAs yuOos s[dH[NUI UONe du .p 
SOPOYJOUL Sd] 39 JOWIOp og ‘OIOLNeU osevuUOT[HUeYOS | eB NIMODOI sed jeAe,U UO.] IS dI]]IondoI1 939 yeINe INnb sonjoxs 
suonsonb xne dAneal UOTeULIOJUI,| op onsed oun JoIANOdeI op ‘ofdyynw uoHenduit,| Ins sogpuoy sayuonbesqns sasAyeue 
Sop SIO] ‘a]qIssod jos [I.nb uye ‘sanjoxs suonsonb sap saanorpeid yuos nb suonsenb sop suusiduos unoeys onb uosey o]]9} 
ap S99J0 JUOS soeUUONsonb sa] ‘suonsonb ap syuowouteyous sop yuRVOduI0S suoHeNgIs soy sUdutos A ‘soxaydutos suonipuos 
sop suep sonbiydde o139 jnod spoyjoW eT ‘UOWOIOyeII[e soUUOTDITES syURpUOdsI sap eB soaNsTUTWUpe og JURADP sUOT}soNb 
ap s[quIDSUd-snos UN UNoRYO JURUDJUOD [OIOLNeU sseUUOT[HURYIE,p soieUUONsoNb sop Jodi ap jueyouLIed apoyjouU 
oun.p UOHeNyeAd,] 39 UONeIOgRIO,| WOSp spore yuosoid a] ‘asepuos sed ajgnbuse oun.p yueusAoId sajyofdtu0s saguUOp 
ap osAyeue.p plepurys sopoyjour soy sonbrydde ynod 9ysAyeur | ‘soydnynur suoryeynduunt sap uonee.o vy] soide nb sored ‘Joroujew 
uo]]QUeYOS UN,p jURUdAOId saguUOP sea] JasATeue Imod juRUd} Jso ‘JUoNbueUT smMeTeA sap saTfonbsay inod saguUOp soy 
Joqrey) inod jurod ne ast ayuayeadjod oysoidde oun “(2 g6] ulqny) s[dyjnu uoyeynduit | e smosal aq] ‘sayuenbuew saguuop 
Sop SWWIOS JaJapIsuod jnod uo] onb 99 9910 joIOLneU oseuUOT]HUeYOS .p ued uN UOTes JUepuodal onbeyo ke ajgnbus oun,p 
suonsonb sap s[quiasua-snos un.nb Jasod ou ap yey oT *« [oIoNjeur oseuUOT[HULYD9 » p suejd no « gpurds ameUUOT}sonb » 
ev sued sgjodde yuos odd} 90 op asepuos op suid so] “soyquiasua-snos soo op un] e.nb apuodai ou op yuepuodai onbeys 
e JopueWop B Ja SaTqUIasUd-snos Ud ajgnbus ouN.p suoNsonb so] yuowUapnud Jodnoie1 e aystsuod swWaTqQo1d 99 e JaNyUDAN 
Qpowlos UP) ‘osUOddI op NROpIR] 9] 39 SJNOd So] NOOR vB INb 90 ‘sue Sap [J ne gUSUITNe JUSWIOTeIDUNS & ‘SONADTUD sop soINnp 
eR] JUonbgsuod Jed jo ‘saygnbus sao Jed syaAnoo sjofns op siquiou gq] ‘seuoyeU uoNendod ev] op soaneyuosoidai o\stpIqeqo1d 
osvuuol[Hueyos sed sajyonbua.p yueuaaoid saguuop sop JWOANOs JUAasT{yN sonbyjod sap sayqesuodsal so] 39 smMoYoIOYO sa] 


suINsay 


, UOSUYOL *T PAOJID 39 JJozjey “¢ WOAATA 
‘JayUIYIS [aUVYjVN] “UvyeuUNy Sey ‘Y 1O[JOALL], ‘seuroy |, [VON 


ADAING UONVUIMILXY UOULYNNY 
pue yyvoH] [vue RB] Op JUBUIAOAd SaQUUOp op opie | 
B PPDLOVU OSvUUOT[HULYII,p SOPpoyIIW Sop UOHENTBAD 9U 


Lvc 


anbojeyeo ne GdX-1L00-ZL .N ‘epeued anbysijeys 
LSZ-Lvz “dd ‘Z .N ‘ZE ION 
900Z diqws<deap ‘ajeanbuse.p sanbiuyoe | 


meso moesornam atti: 


psnaiiie wait sam! aawonp a 
rales oer await 
, ? 1 4 wh 
‘piano wahay st sack re b iygurngr neg 
ti ee : aoe ‘min Ayu jee: ‘i ade nage Inheags 
pa re pe * F yay, # ¥ i) 
m ; i ‘i wr, sf MPA i A a mii M. ah enh en! 
| ens van), ul one fay aa Jigh obvi! rs ‘ofa agi " Th sayey * “nye vif F yahiind 
ni vi i We id) aula olin a a Mlabe Ber iy bes | 
i" bisa bh Pipe: a | ‘a A. +2 Taig j 
) A » oi am Ie | in a ; ¥ aN iy ? ‘ls 4 : iit pea? i 
‘ a “lenin tot Aparna obi ii’ wee mig HTT ah MR 28 1, INH Com gpa 
7 th wos te Sead iar , ie a seat cad alae gieshd aA a 
ond hit tte yo" api bet aiid, | yess AtKl At woe vison K want staal 1 Pn eT brie (ret yo ae Ce? eee is 
car 0 UNTO vie! ins set gaa AIG Pea) pan! beta. vent aig i aos 9 ; ui ohh: a 
ri fh mr » ee ae Oe ee 2 Repeat? BIEN PN, | wit ey eS i 
ai <5 BRD weactoninmsiarss Kanempaenag souk ante un ut nYOPIN wey) eu) | ’ ea ar ree 
nipeaaaap a nie a aio yt op Ta ge i iy a AO shay wi a aces a 
aap A thi) 4 ni iy ‘ r i J 
| anjqne His: i) (OpAe) oy Wey hi ¥ mot iit j i a sie Pua ¥ vent ib 1a j j 1.8 ie vi has " 
earn ro she aie ie t0 Kons mith gutter prt wok ial ay ss Wn Gh 
ck phy wo) Ah Ae SHRED OR) eR: dy Ki PP) Wa ale ae 
‘ wie wb Jayson nad ih od pyres bnsfuginy cat on ene i ‘mh wand baapleesony, saiberetae fag is ng 1 ed i A 
pater! WG. iaaienies as Wineries ie atewog sod wiyeN eg) a ih i aA GaN i Va atur 
DOMME FR Adenia, Tit SAR GRN., SORTER shins 


ten oy a SA rem Neale herpeeant.) At geile mony 
es 4 " ‘wit ‘ * m: SARE So Fi , iy > aimee 
; mt pies a) seweutwo. 1 Ww auratus Lesthiadt wy Pd 1) RITA AREY Nabari sit) al a the yield 
" MITC NU Arie pi a ba te hay | 
ei ap oe So > Fru cai is) Sap, ans Sepa) fa, aerbaltes, Hag ape 
{ i i ; ‘all i nah 
ease glint! recieve Whaat hut cit LOL 
i iat, ow a . . Pees fk w ph i) Bi AF SYS OA) ARTF ys +P eee 
coh s hrs te ER GT Cte iaiw Viieer Gaus HoT, Wek tual sibay rn ; ey 
oi! ; ree) eRe, m ah bhi Pah ae aee hee Hah 
ale . : Far Wa C4 hat We Thee | ( Re wl is ae are ; ; 
UG a a 7 shay HOC 8 canel AA ne ea nh a Ae wr) et 
- " oh fe hae - i , nw o P an iP + Adee) oy Ne 4 . 
iL 3 Git ots ree an Gris, pai Ghd AD RREY egee NPA TRE Lai a OT A” hw Pr vy 
ayy A hele say Gt): eb) PT UL Le es lth me 
i ¥ mn oe oe = / navi as sath ies i . : . ; 
ay TS Binney! ny, atl ; ie CR Ga ON SE PRINS ne We RPE AE (QR | 
hed ‘th ‘bg aa Apr . eR) Me <1 aie ¥ ; 
a i 4 AM ys Wy ae < ‘ ny he ’ , / He 4 A hth 
a ee heen P cries mrs v- od y ay Beial® i ii : vite pis" AAT iwi nf ie, 
as Ei iy enema a ne seat hn 0 selene NU ke Hb 
cll 4 i af iy 7 a sf _ ad ' es : } ary i we a) v 


i ae 7 h 
alt ) me) eel cae ey "dee ; | , 
a ‘ ai iw 0 <n |, elenk ong ee ree a hil, go 
ray. No ie eke Faget ee a . ) Mar, i D> RTD ROT ij ve it a dg 3h AAD HRD. 
| ) ’ {UR is vi wa Aa ae jm Lae avy! | ae TAL 
0) i, vee 


re 
ee raey ieoud 9 te i gi DI eet 
i yearar 
aK wae MY an ~ fyi whe tg er ° nap 
nN ) hh De ery 


ie ay 7) inant Nita | , 
oom rei Cire” praitiay earaye it a) r i Bach pias ills 
Wi Scan meiatcn,.hese igen se ed are ae ars sac ns om the 
ow i ay Aifey hy! f apie nb: mt , th Tha af ; 


a vey a 

, ei nee De oalte : ee Sis 

i jerk ities eer sh 
fray aio FRY) CARRE VlagHanene wkD SURE! apes yd. 

| Cenigaie ie yitn\ woranaipen calf ISON: On Ky, fp yet ear 
i... Gy pe gpg TYRE, th a YON pec) 

Fi icebanenraned va stat bboy “He 
po renrnasyt ft 

vis apeigggatey © OM) fe f 


Ni lige was 


Mey we 


ional pelt yiteuee 


anBoyejeo ne GdX-[00-ZI .N ‘epeueD onbnsneisg 


‘OUT ‘SUOS 29 ADTIMA UYOL 7YIOX MON ‘aIUasafuT puv Bu1jdups 
uounjndog aiiuLy (0007) Wa TeAoy 39 “H’V “ueUysog “Y jueTyeEA 
"YIOX MON “osutdg “surdung daaing 
paisisso apo (Z661) “f “WeUeIM 19 “{ “UOSsuaMg “q-"D ‘TepuRS 
ELY-£9h “POI “ABojonuapidy fo 
JDUANOL, UDILIAUP “SOIpNys [eUOTFRAIOSgO UeUUNY Joy suoneorduy 
‘AJooyy + suldures ul soourape yormg (9/61) Wy ‘Wedoy 


‘/Syoog/sJo-loqu Mmm //:dyy ‘aspuquies) 

VAAN ‘saxapuy aig puo vjoq sauuvdg uo aouasafuoy ay) fo 
SSUIPIAIOAT Tq) BY} JOF soxapul JouURIS “(Q00Z) "H'd “UOspreyory 

JPA TVANVW TVOINHOEL Idu/Atiouose outoyy/speopumop 

PWaos sonsynyisMMmM//:dyy e UopuoT ‘soyjoO Areuonrs sy] 
‘royxeg ‘WW ‘PA) (8661) /onunyy portuysey, XOpUuy S24 [IPIOY PUY] 

“IOANOOUR A, ‘SAXAPUT AIL UO 

aUasdafuoy MITMO-MAIN FOOT 2une ay) fo ssurpaacosg ‘oryered 

VY ‘Xopur souid Jaumsuos oy} ynoge SuryuIy [euorssayoid Jo sieok 
AJUIN :SMAIAOI JO METAL W “(S0OT) “AT WIGUL 19 “W Jropsursy 


6E?C 


"S9-9¢ ‘suOISSag 
gq Appuop ‘aduasafuoyd Yyosbasay ABojopoyjay oousybIg 
UO aaj, Jo4apa] yf JO SBuIpaad0{q ‘SIOYeUSS XopuT soLId 
UO SUOTILAIOSGO SWOS (6661) ‘f ‘WIT 10 “D'S “oAvay] “HV ‘ueuyiog 


‘Jpd's}daou09 /LIaMaIp/ed‘9qn"uo0dd 
“MMM //:dyY Be ‘epeuRD “IaAnoouRA ‘JUoWOINseay\] pue s}dsou0D 
XOPUT SOLIg UO SOUdIIJUOD DYHSS ou} ye poyuasoig ‘sosusyyeyo 
smn pue ssoisoid yseg :Alooy) Joquinu xopuy “(p00TZ) “A “HOMmoIq 


LE-LT “€ “OL ‘MOIADY SINOT “Ig Jo JURY oatosoy [e1opo,] 
‘[XOOTIM “MA'C 90 Omtdeys ‘C'W Jed Jd) oY} Ul seo Suneses3y 
Joy soisayeng saneuloyy, ins] ,AreyuowU0D,, (1661) “A “omoiqd 


“EL I-€8 ‘I “99 ‘anbysunig ap appuoypuejuy anaay “Soorput 
sould Joumsuos jo AjyIqeredwioo ay} uO saIpms (R661) ‘f ‘UsTeG 


“SHEE 
‘I ‘¢z ‘ajanbua p sanbiuyray ‘a\st{igeqoid asepuos ne uontsoddo 
Jed uoIsnjourp [Ines a] : UOReUTWOSUOD x] eB xd sap sorput | Inod 


syinpoid sap x1oy FT (6661) ‘OD “MYDS 19 “g ‘seopsoddo “fp “‘ueeH 9G 


Jpd'sooz yenuepy yeoruysay [qO/Awlouose swioY/speoyuMmop 
PWAOS'sonsyesmam//:dyy  ‘UopuoT ‘sonsneig jeuonen 
JO} SYJO (SOOT) JOnUuKW JooluYysaT, Saxapuy adldg sAaUNsUuoD 


‘uy’ suonduosap 


/S|q/aossiq'syeis/;duy (S007) + spoyrayy fo YyooqpuyHT ST 


900Z auqwasd—ap ‘ajenbua,p senbiuyoe | 


‘sued 
‘“(dnovQ DMDYQ) SAdIpUuy ad4g Uo dno‘ Bulysosy JDUOIDUAAIUT 
ayy fo Buljaayy Yyjuadagy ay) fo ssuipaad04ig “yoroidde Surjdures 
wy :sayesoisse AreyUOW[a JOJ soxopul sug (€00Z) “A Wed 


+q 
Uo}SUIYseA\ ‘ST ‘saa1puy adi uo dnosy BuLjsoy JOUOIIDUAQIUT 
ayy fo suljaay Yyjinot ayy fo séumpaacr0jg  “saoipurqns 
gouid Jounsuod se sonjeA yun Jo osn 34) UO (6661) ‘A Wed 


ary deisorqrg 


‘DUuNUXOU IBeUUOT[HULYSI ,P OLIBUZDS 9] WUINOF onb 
xO JUOS Sapoe S90 Jo ‘sapuess snyd soy yuoutonbryeurgss 
yuos sgyquenb soy sjonbsoy snod xnoo sed gyuasgidor xnorw 
yso JI ‘saponse.p uoymueyss ynod un Jed gyuasaidol ano 
nod ysye A Op SOIPUT,| NO IINSOU RI SURP : « dINIG 9dJ0} » ap 
ouIsTURSU oT Wed eB YUotONbHeUIg}shs soUUOTTIURYDS JUOS 
SNPUSA XNdIU say syinpoid sayz onbsso] ysTeAA op UoTye~ndod 
SP SOIPUT.| RIGS Welssp jomnq sp VoT[HURyoS Pp Sorput.| 
1onbinod juenbryjdxo uostes ane ouNoNe SUOAOA 3U SHON, 

‘i 4p “h My 
jdd anb unajiau nod un ang s{quies buiwuxpus ‘a{quadsud ,| 
suep ‘jo ‘syUdIOIJIp yUOS syustayIoduios say ydd aseuuo]y 
-ueysd | op saneurxoidde uoneut.y, sed sonbijdxe ano 
sed yusAnod ou joynqy op IM9}yeUIsa | e souIquIOS buzuxDUL 
SLUT] HULYDI | OP S}aJJo suog say aonb suonpouos snoN 


6LE OTE SVE HIP 9°96 L’68 0061 — 6661 
Lb OLE vIv 9°76 878 L°68 6661 — 8661 
er9 Trt vIv OOOT 798 L°68 8661 - L661 
917 OLE LSE 0001 9°96 768 L661 — 9661 
bo OBS ACS. C9SWI £6 A 78. P9667 $661 


p adn ¢ adn Z adn » adn ¢ adn Z adn 
aqinf snjd aqinf snjd 
iddap WOT (4 iddap swig (e 


buluxpu sdeuUoT[HUeYd9 , | 
mod onb ( '*h“h/* = ayqeizea are) ayy1e1 eT & 
aTJouuon10do1d syyiqeqoid soAv oseUUOT|HULYDN ,| 
Inod sajqrey snyd Uos YsTeA\ Op 9[QID soIpuT 
un Inod joyng op so1pul.| ap suuaAow onbryerpenb 
INIA J 19 stetq a] jonbs] mod qNy,,p o8ejUD0INOg 


ST nesqeL 
6bb LOT 8h OSL VL L‘68 0061-6661 
80r 6SL €8h VOL OSL VTL 6661-8661 
6th LT HIv 98L OSL SSO 8661 - L661 
SIs ss9 9s SSO HZL L009 = L661 — 9661 
‘19 I'19 €49 6SL 798 OSL 9661 —S66I 


padn ¢ adn Z adn p adn ¢ adn Z adn 


( *4b*b)* dd 


osvuUO]]UeYI,p SOLIeUgOS XNap Inod YsTe AA 
Op 9[QIO soIpul uN nod j1zIsod ste1q un ayuasoid 
JONG Ip s01pul | Jonbey Inod ANV .p eseIUSOINOg 
py neo[qey 


buiuxput 


‘bunuxou xed 
syinpoid sieviq sop ayyeuUOeIpIq ek] JURYSeS JNoyMS ‘fIsTOOp 
snjd ora} uN yuR}D oUTUTIOD sUUDAOU onbHeIpenb mod J 


ansdojeyeo ne Gq@X-100-ZI N ‘epeueg onbysyeisg 


SUOIOPISUOD SNON, “xnop Jnes ‘adnjepotiod suosteurquios 
So] soyno} IMod sjeyNsoI smojioul op suuop bumuxou 
‘Tor Jo ouudAow! onbyespenb mo.1o spuess snd oun ympo.d 
e bunuxou jonbst Inod ANV Pp deyUeoIod a] suUOp (q)>s] 
negfqe} os] yWUepusdsg “moaypiow yso ydd oseuuoT[HueYd9 | 
‘piesa wo wy ('“b “b)jdd np myjao onb yueyodunt 
snyd 4s bunuxou op UONRsI[NN,| & Np Njosqe sreiq oy jonbo] 
mod qNVy.p oseyusomod sa] suUOp (ke) S| Nea]qQe) IT 
‘JUDWIDATJeSOU nb yUSWdATHTSOd sasIeIq 
Issne }NO} S}ey[NsoI sop ouUOp buwxow sseuUOT[ULYDE ,| 
onb suojejsuod snou ‘yyI1S0d sierq un oimMpoid e soURpUd} 
v jdd aseuuo][nueyos | “nagid oum0*D ‘aseuUOT]HUeYD9 .p 
spout onbeyo inod jJnisod sreiq un yuozuasoid zojnq op 
SOITeJUSUID]O SOdIpUI soy Jonbsy] nod ANY ,p osejus0In0d 
3] ouUOp yp] Neaqe} oJ ‘adn onbeyo jo soguue.p 
oiled onbeyos mod qNVy sep syquiosus.] Ins sagynojeo 
99 JUO soueUTUIOS sonbysye}s say ‘osvuUOTTHUeYDI .p 
dspoyjou onbeyo Inod sasessed QOS INS soapuoj qwusTe9 
WOd. oP 39 sieviq np suoneumss soq «(1b “b/‘)jdd 
onb tsure buwxpw aseuuojnueyos | nod ‘“qny onbeyo 
Inod jojngq op dsdIpul.| op ‘YsjeA\ op uUoTe;ndod op 
sorpul | @ wodde1 red ‘ouusdow onbryerpenb smart .] 30 
sIevIq d] SWS SUOAR snoU ‘aseuUOT[ULYOE Pp sopoy}ouUl 
XNOP So] dU UONLIOI ev] sIpUsIdWIOS xnoTW op UV 
"JUSUDYOR] STU ‘SgTTOI o.NQ JUOTQuIAS (,, PD ,b/*)sdd yo 
HuluxoU SaseuUUOT[HULYS Soy “USWIDAILIG ‘spoyVoU o.yNe | 
no oun, | Jed souUOdaT9S oO B 9OURpUd} snyd 9] UO Inb xnoo 
OP dIIP-e-]S9,9 “« SJURUTWOP sopoTe »> Sop UOTHLILIOD SUTeLIOO 
oun aystxo [I (o Vdd aseuuoynueyse red souUONde[9S xNoo 
ap s[quIasud-snos uN yUONySUOD HbuluxDW sseUUOT[HULYOS 
Jed sguuonosyes sojponse sol (q ‘souUOMooTEs soporte sop 
uolsiodsip opueis snd oun ynpoid ydd oseuuoynueyss | (e 
onb “Jouu0j}9 snou sues juoWoJonUS sed ‘suonjouos 
SNON ‘JUSWMSMV.RIQIe SOUUONIETIS sTHeIUAsSoIdaI sed SUTeLIOO 
Inod ‘uoTTHURYDS,| SURP soUUONDETIS 939 JO syUdIOTFIP 
sgjonse sap onb (sasessed Ogg ims) slo} op oddeyusomod 
9] ouUUOp ¢] Neogqe) 9] “27 Suep stiduIod sajonie sap 
(2b) asidd oseuuonueyo9 sed no bunuxow sseuuoy[y 
-ueyos Jed souuonseyas 919 yUO sofonie sion ‘9 7NP ‘7 adn 
onbeys snod ‘auryovur-osessed onbeyo mog ‘souuonssy[9s 
soponse soy auadu09 Inb 99 ud a[quiooidde yuoWoyoneAsyo 
un JoyUasaid eB dOULPUd} JUSUOATIOOJFO JUO OSeUUOT|HULYDO .P 
sopoul xnop soy IS JopueUIap snouU SUOASP snoN 
‘ydd aseuuo][Hueyos .p OLeUg0S 
9] SNOS YSTVAA IP SOIPUT,] JOJJO Ud [QO zoynq] ap SOdIPUT,] 
‘TnIsod yUSWATeIOUaS 4SO “JO.UOU do] SUOANOd snouU sUTWOS 
‘tnb ‘janjiqey onel op sieiq (1as9]) a] wed e ‘Juonbgsuod 
I&g ‘YS[eM IP SOIpUL,| So Soosodsa sINOTeA xNIp $90 op ONeI 
YX] ‘INaeurMousp 9] Inod oieypMuIs UoTssaidxo uN SsuOUD}qGO 
SnNON ‘WOU No UOT]HULYDE,| SUep 4Sd {7 IS ‘(Q NO | Op Moyea 
e] JUvUSId oTO;eITe INdyeoIpUT UN 4so “7 Jo DSeUUOT]HULYDS .p 
uejd ne yodder sd ooueiodsoy oymsis ()"7 no 


UOI}EWIWOSUOD ke] & XIId Sep S8diIpU! sa] JNOd eHepuos ap suejq : UeWHS// }9 JAAS] ‘JUD ‘UBLULOG QZ 


ansojejeo ne GqX-[00-ZI .N ‘epeueD onbnsneisg 


1 tb bh 

pa! ee eRe wll S = 
n> 

ia ‘I <a 


| 


(#8) 
SUOAB 


snou ‘ajsTiqeqoid aseuUO][HULYd9 .p OLIBUDOS 9] Snos YojnqT 
ap SOIpUL,| Op MojyeloumuU np souviodsa J Mod “ayo uq 
‘JHeIAJodns sorpur oNe yo} nod “uautad0IIput “juonbgsuoo 
Jed ‘49 ysTeMA Sp d{QID SoIpUT UN Imod sieIq suRS JUOWIOANLUL 
-rxoidde ys jong ap sorput,| “(,,..2,2/) asidd odeuuoy[y 
-uevyo9,| nod : , (b b/s a]qetiea alte} soe ydd oseuuo][y 
-UPYd | & JUOWI|QRIOpPIsSUOD sTqUIASSe1 buiwuxow sseuUOT[N 
-ueyod | onb Jonbsewiol yey e snou smoyeuTUTeXO UG) 
{sfuepodns saorput soy mod stetq ap 
douasqe oun e Nol] JouUOp juesstesed ‘s}e}[nsoJ suog Issne .p 
gJo-}-ouuop jojng/bumuxow uosteulquios ve] tonbmog 


JOING/bulNUxXDUL UOSTBUIQUIOD &'T 
29 oxouuy 


90tpul 
un.p UOT}ONYSUOD ke] Ap JoUassa JUOWUIT9 UN 4Sd dIQIey 
snjd 9] neoATU ne a[qeTeA aIMpsoold oun nb swiaIyUOS yeyNsaI 
ap o1uas 95 ‘s}yepJodns soorpul soy 39 SosAadse'] op ddIpul,| 
no anbijauoas auuadoul &] dUd 11e99 J B JOWIDATeIedUIOD 
SO[GIe] JOS S[q “JOYS OP SOIPUT.] 39 SOOIPUI sod oNUA 
SoqJ29 onb orpso sWQU Np jos ssdUaIEIp soo ‘uepuoday 
‘dagTa snyjd nod un a9 & soURpUd} JURAR 19-INJ99 ‘YSTeA\ Op 
SOMJUDULD[D SOOIPUI Sap solAodse’T UOTAS JeSOIBE | 19 YSTeAA 
ap a]Jo01 UoHe[ndod op sorpul | oyUd a[qudoojed yess UN 
SUOAIOSGO SNON ‘6 Nesyqe} ne souUOp JOS s}e\[NSOI SOT 
‘aseq op apotiod 
e] & prepurys sprod soy yuos “s sat NO ‘cM 'SXXX 
= «iT “(KUSTEAL OP ZeSIo») YseA\ 9p someyuoUIg]D 
SdoIpUI,.p saidodse’'T uojas uONesaIse OUN vIDO B SUOTedUOS 
snoN ‘sotidoidde ysjeAy, op uonesoise.p spiod say jos 


id a? iP Ke 


pa Hl 


Lec 


yso « ind » ysje Ay, 
Op SoIpul,'J ‘dD oxouue | e BDUUOP 3sd YSTeAA OP SOIPUT.] Ns 
suo.Qua0U0d snou snou sTjenbey mod uostel eT ‘sosAodseT 
Op I|NUOJ OUN UOTAS YS[eA\ IP SOJTeJUDUII[D SOOIPUT sop 
uonesaIse,| Op JRINSOI sooIpUul xne Ys[eA\ op UoNendod 
Op SddIPUI Soy sUOIedUIOD SNON ‘SoJIeUSUII[9 sSooIpUl 
Sd] olMysuOD IMod sesijyn spoyjoU ev] ap souRVOduUII | 
JONSNI]I.p ona ud oyduuts ojdurexo un 1o1 suoyuosoid snON 


UOHVSIASE PP I[qIvy 
snjd oy NvaATU Np sdUv}.10d UT | JUB.YSNyL odwsexy 
q oxouuy 


N is sone sap 
ster) quuakoy 
al ay 
(« sonbnouyyiie souusAoul sop sia ») 
228 Jojnqd 


nif iS 


oe 
a? BU | ad, Ke 


= — ouleyun moje 


N/1=' 
no 
hid 
K s='m 
‘b Va ; 
no 
A ey onbinswi0es 
at cay al an LY QUO 
ad ouusA0J] 
Pore Dide 4 1 
swe es ser I ae 
no 
aes 
St 18 peri Pisa ISIADUIQ |, 
igi +4 


I+ “a 


900Z auquwiac~ap ‘ajanbua,p senbiuyoo |; 


dT) 


4,4 a id <b i I JOYSt{ 
zt eat PORk pl Dok 
mal iD 
—“Soaniee 1s 7. YsyeM 
ed <0 cb Kk 
id (BT 
Fo ace, e 
'd 'b 
itu = soikodse] 


add {b K 


uoynendod op sadipuy — s3tqiry 
V oxouuy 


‘opoIe yuasold np syeuly UOTINJOAD ,] 
QUdTIO yO Joy Ud IMdJO"par onb juR} Ud sUONsEsSsNs soy 
qUOp YSUIS ‘q'W soISOI Np syuUIASeMOosUD soy JOUSTTNOS 
e JyUoWZTeIDONdS yno} SUOUd} SNON ‘soy suoysassns smd] 
Iod ‘uoyynopy “gq 39 JOpsuloy ‘Py ‘UeeHHoq ‘f¢ onb sure 
‘opnjd | sIpud}a e SJUOWOSeINODUD SIMI] ap 39 S}HON.SsUOD 
SOIIBJUSUTTUIOD SINd] op JUIOfpe mMojoepel uN jo smMoyeUTU 
-€X9 SION JUSUI[VS9 JUSIOIOUIOI Sayne soa] ‘TUp-ouneAOY 
NP DdI.] Op JUSWIASSTTQe}O .P SOPOYIOU So] INS UOTeJUOWNSOp 
P] Op 39 SuoNeol[dxs sap TUMOJ MOA INIT op ‘sntueD UME 
yo TTequeupy “IdATIS YO, 39 ‘SoLIosayeo Ua soayesIg0 
Sop UONVOTISsRID eT INS xneavy so, Mod ‘uopayUIg 09S 
yo sodeyy efuog ‘oumuou yutod e mindde may] op 39 sayeaig9 


ansojejeo ne GqX-[00-ZI oN ‘epeueg onbysyeis 


So] INS sOQUUOP Soy TUINOJ MOAR IMI] op [eJUNZOY eqnAT 
yO UOSpIeYOrY pared JWOoIoIoWdI smoyne sayz ‘slup-s}1e1q 
sop sonsneig uonepodsurly Jo neoing np tu sonsyes joqr’y 
jo neoing np onbiyjod ey] sed yuojyuasaidol ou 39 smmayne sop 
SQ]]JOO JUOS sfoIUIe JUasoid a] suep sooutidxe suotuido sa] 


SJUIMII AIM Y 


(9QL6I TeAOY ‘TI Uonses ‘cQoz Ned 39 
JAOpsuloy) syensedut p souosedde | 39 oyyensedun | Jomsse 
Iod stew ‘sonbysyejs suostel sap inod sed uou—ssiyequeo 
asevuUo][HULYdS | op pieso,] e yUopnid yoUIoIESa] Jo.NUOUT 
9s op “Joynonied ua 4a aseuUOT{HURYDE,p snssadoid np 
Sope}s SUIe}IOD B UOnesIWOpUeI op asop sun JayOfUI Pp 9]1qQe} 
-leynos jresos [I ‘onbyeid uq yuawassysaap Joop Ul) 
([I-yWeso\sIsiod os vuUOT] HULDA _p 
yuoWoyIodur0s uog a ‘soUasqe UOS Ud ‘Jo onbidAy aT[a-3s9 
assaysnf 93390 amsour ayjenb sueq ‘(]{ neojqe} a] aNsNqII,] 
SUIWUOD) syyepodns soorpul xne yoddel ied yojng op uoney] 
-ndod ap sd1pul.| op ayuvuu0j9 ossaysnf ve] & oITO1 aN9 ynod 
jojnq/buiuxpu sysoidde | ap yuoutayIodw09 Uo 9] ‘aInsou 
ouIeyiod oun sue ‘SJURSSOIDIUT yUOUMOIOTTNONIed yUsTeIIS 
soyuryodumt snjd yuos xud sop suonenjonyy soy Op sajorie 
SaT ‘soyeoiso say onb sympoid sonnep mod soarjjionsel 
soguuevos soouUOp xne opmjd,] ospudja.p ayn jes ]] 
‘apnyd ayuasoid ve] o1puajUd assTe] a] ou aonb 
Qpueis snd o109ud Hos stup)-s}e1q xne onbiydde a\sqIQeqoid 
aseuuolnueyss | e Yoddes red 1u)-aunekoy np oysoidde | 
ap WoLIedns ey onb 90 & opuayye snou suoAnod snou ‘suuop 
yospnq un mod ‘ouog ‘aJAna,p-ulewl op sulou jorInbol 
9]U9A op syutod soy suep xud sap dAgfor oy 39 oT qrey snyd 
JUOWUDTTONIIQeY 3S9 IJOUSIA B dJUdA ap syuIod ap siquiou 9] 
‘ISUTY “SOSNd}NOD SUTOUT JUStONbsULHUI JUOS UONRsTUOpuRI 
sues soysoidde say onb nuuodol yuoWaTeI9UaS 4S9 [J 


L891 81 LEO LZ PE sPUUONSaIPs spanbse] suep suoTTHURYD?,p % 
I€LI ~@%6Z 998T PLT sguUOoEI9S sopoe bunuxou 
L79 89 €56 LOII CPI €61Z LOE spuUOHDaI9s sjonbso] suep sUOT|HULYDE,P % 
C0h "SST COC BLET. CHLI, 1998 1 TELI SPUUO 99S SopOIe idd 
10b ANV + adn ‘g autey “0007 — 6661 
LUvl SI = LevZ LT‘9P spUUOHoEIPs sjanbsa] suep suoT|HURYDS,P % 
ZrLI 9987 IELI 8LEZ spuUOoeI9s sapore busuxpu 
LT St Ltr OF LG ELT SZI BBI LEE sPUUOHDaTYs sfonbso] suep suoT|HUBYOD,P % 
Peseta PISeSC PEL ES PCEOT CHET O98 SLET TEL SgUUON9I9S SapOHe idd 
10b ANV € adn ‘g auteY “9661 — $661 
E161 L8‘O spuUONoeI9s sjanbso] suep suoj]HULYS,P % 
€O8Z 6887 squuonseyes soponsze bumuxpu 
r0 8680 «680 CET OES «OLSE OS = HOL = T'ZE SEH — SPUUOHAIPs sjonbsay sup sUOTTHURYIE,P % 
OS8Z O9L 9LLZ HET THT BSST E€9LT PIST €O8Z 6887 SJUUONIEIIS SOpOIIE add 


SOI ANV 7 2dn *g outeYd “9661 — S661 


suoynueyss gs suep '*+“b“b/ pdd yo bunuxow red sguuonsegs spony 
eT nvs[qeL 


UONEWLWOSUOD ke] & XIId Sep S8dIpU! sa} JNod aGepuos ap suejq : uewWHa/, }9 JOAeA7] ‘JUS ‘UEWYOG 


9EC 


ansojeyeo ne GqX-100-ZI oN ‘epeueg onbrsyeis 


09S‘0 899°0 ILUI 616°0 ty — SolteulpiO 
7790 8160 IIv‘0 €79°0 Ch — SodteuIpIO 
L6£0 S6C | 6050 LOTT Tp — Soileurpio 
vL.9°0 LECO os¢‘O 9750 ce — Sopyn1iy 
800°1 8L9°0 €rr'0 0LS‘0 Tg — Sepyint{y 
80S°0 96L°0 68L‘0 6L'0 €C — S9919N§ 
1L9°0 ISL‘0 9LL‘0 OLE‘0 CC — S99I9N§ 
776-0 9ETT €65‘0 LSL‘0 17 — Septong 
€r8‘0 Eel 6650 6691 cI — sepney) 
LS9‘0 099°0 L09°0 8PrL‘0 TT — sepney) 
SUOTINIS /SOPOTUL _P SO}VNS 
6S€°0 poll 0950 S160 SoTeUuIpIO — 7 
7580 £970 €ZEO 60¢°0 Soon — € 
L6L‘0 1760 9L9°0 €9S‘0 SOQIONG — 7 
S9L‘0 O87'T S6r'0 6€S‘I sopney) — | 
sodnois spuvip/so10s9ye9 
L950 €66'0 86r°0 8rL‘0 SopoTe Soy SNOT 
000C — 6661 6661 — 8661 8661 — L661 L661 — 9661 uondr1osoq 


anbisjauoas auuadou yo (sasuadap)4njdd snsiaa jojng yo b ap sagyeoep simayea so] juRsTTyN 
Us bunuxpul : YSTeA\ OP S2TqQId soorpur “g ouleYyo “\-"q Sop WOM PI & ‘A-"A OP WOAY 2] op soney 
CE nvslqeL 


‘sonuuos uoyerndod ap sasuadgp so] JURSITNN Ua SoIeJUOUID]E SOOIPUI Sop SUOTIeUUT}SO 
Sd] 93918e SUOAR SNoU ‘[eqo]s SdIPUI,] Op SUOT}eUISA Sap INUA}GO INog Jueosoidal spoNIe/ANV,] op neoalu ny , 


89 v8 89 69 08 Anjddjanbiajauioas auuadopy 

6¢ €8 ve Sb = sadnatsajuv b ‘huiuxow/jojng 

Cl 9¢ iL 0¢ ce buiuxoujjojng 
000T— 6661 6661-8661 8661—L66I L661 — 9661 9661 — S661 

suuskow onbyeipenb mau9,] ap surrey (9 

0c 81 LI SI ce Anjddjanbisjauoas auuadopy 

vl SI Cl vl a sadnatsgjup b ‘buiuxouyjojnq 

Gl val IT 6 (I 91 buiuxoujjoing 
000C— 6661 6661-8661 8661—L66I L661 — 9661 9661 — S66I 

oddy-yreoq (q 

99 c8 99 (6) 8L Apjddjanbisjauoas auuacoyy 

oF C8 és oP rs saanatsajup b ‘bunuxoujjojng 

‘0 Bo Ci cl 67 bumuxouyjjojng 
000C— 6661 6661— 8661 8661—L66I L661 — 9661 9661 — S66l 

steig (& 


4 SOIEJUSUI[9 SOIPUI SOP UOTJeU)sd/aseuUOT]HULYDE ,p 
soyooidde sto.) Ins s9puo}j ‘g oUIeYD ‘soTe9199 Sap aTquidsud | Inod ysyeAA op UONe|ndod op 
QOIPUI | Op UOTJeWIsSa | sUep ‘(QOQ [ ed sotjdyynuI sno}) suUdAOW onbiyeIpenb Mod | op sutoes yo 9dA}-1.1899 ‘sTeIg 
TT nesqey 


‘SUISESLU Sd] SULP dseUUOTHULYSE | Inod sogsi]In 939 UO 
aseq op sporiod vy] op sasuadap soy saynas no ‘suorjejNUIIs sou 
SUeP 9AJOSqO SUOAR SnoU onb sIeIg do] JonUSye yWeLMOd eaD 
‘9]U90901 OpoLiad ve] op Ja aseq op aporiad ev] ap sasuadap sop 
syed sap s9ssl] suUdAOW oUN JUdUATTO91 Jso INb sasuadap 
sop ued ev] op uoneumjso oun soide.p ajudA op sjutod 
So] SUBP SoToTJe sop JuoUTUONbay JoUUOT]HURYSE JUOTe.LMOd 
SIU()-S}e} SOP UTL.LI} Op saysTUOUODS soy ‘onbyeid ud ‘sIoy 
-no -soast[nn suoae snou onb bumuxpu ap sagjeoep uou 
}9 Sd9[BIIP SUOISIOA Sap xNIo aUd sLIduIOS a9 WeLMOd JoaI 
JOJO | ‘UO “UR UN vA [Ip SaT]a0 aonb sayuaoe1 snjd soguuOp 


GSEc 


sop Ins gpuoy ano yeLmod mopusa mojo ne yuenb 
UILLI9} OP d}SMMUOUODY | op UstUASN! 9] ‘WoIOMs aq ‘s}ey[NsoI 
sMa][Iou ap suUOp TUP-suMNeAOY np sysoidde | onb omyjo 
-U09 op Joyseduia Inod ayueyJoduut yuouuesyyns sed 4so.u 
aT]o : somogque soyuenb sop uoyesiyyn,| op oaynsor mb 
a]]onJed uoNepelsop ve] Op s9pI oUTe}IOD OUN SUOUUOp snou 
‘TAINS OP OpNyo SOU Op dIpPKd d] SUeP ‘jo (| sportod eI) UOTIN 
-UeY99 | OP UOTII9s vB] Op yUOUOU Ne sayqruodsip sed yuOs 
ou 7 spolied ey ap sayquenb soy ‘uowMUeprAs ‘onbyeid uq 
‘a]qrey snyd ua snyd op yrespuatAcp tu, 
-osumneAoy np sysoidde | op sayeyor ouudAow onbyespenb 


900Z auquisas~ep ‘ajenbue,p senbiuyoe | 


Mod ,| onb oJOs op ‘UOTTWURYDE.p d]]Ie} ev] Op yUOUWS 
-stolooe | Jed ay00sje sed yresos ou 9]qlo Jryepiodns sdIpul | 
Inod stup-syeyq sop IMo}eUItsd,] sp sleiq aT ‘oyqrey snjd 
}IeIOINOUIOp Tu;)-eunekoy np oUvIIeA ke] sTeU ‘oNe,| 
yo OUN.| JUONUTUIP onbruuR}Ig 39 SUTeOLIOWIe soyoosdde 
sop soouvlied soy onb 99 eB ospudq}e snou suorLLmod snou ‘194 
-UdUISNe .P UOT[MULYII,p sSoT[Ie} xne sUOTOUIOd snoU IS 
‘QstAbuQ 1, 
op no Ys[eM op “IOYSTY op moo op assise.s [I.nb ‘ayqro 
Juepiodns sorput., onb saaj9 snjd yuoWwslqeispisuod one 
B DOULPUD} WRAP [I ‘OUDG ‘oporied osoTWdId eB] Be sasuadap soy 
Jed sg1apuod anbiyawoas auuatoul ke] Ins gseq uore;ndod 
Op SoIpUI « STRANLU »» dg] IMod steiq suKs 71e}9 [I STRUT ‘sIeIq 
SUBS JULI SUUOD }LIDEp 9.39 JURANOA SOIPUT | Op IN9}eUISS 
un 9uUOp B® sIU)-s}e1q Sop sydoidde J ‘smayie reg “¢ UONDeS 
R] & ayLOap opnyd | oy1osns ® 30 sudsms e& snou mb 90 ueu 
-TWOp sYyoIeU np ssvuUOT[HURYDS snos sJIepJodns soorpuT 
So] JUSTQID JoOING] Bp UOT[HULYDY,p SodIpUT sa] (Z 19 (6661) 
‘Joo 39 UeeFL op Jed oyey 919 velop yeae mb uoNRye\sSuOd 
‘gTqrey snjd souvrea oun v ‘astdins sues ‘ousur “(dD oxouUR J 
B YLOSpP E] Nes[qe} do] MOA ‘oyduuraxe Jed) ssuMONdaI9s sofoTIe 
xne ou] OLys snjd oseuUOT]WURYDS UOS(T : SUOSTRI 
xnop nod amatiadns 3so tup-eumneAoy np sysoidde TJ 
“syeynsol 
sMa][Iou soy suUOp (SouUdAoW sop yodde1) jong x 
onb uargq ‘ahojduua (sone sop suusAoul ey no ‘anbiyawoas 
auuacoul NO “JojnC) NRIATU sI[qQIe} op xd op dOIpUT | ap m9} 
-eUII}S9,| }Ios onb jonb ‘tsure jso ua j[I.nb suomUOUT snON 
‘9]QI9 Jnepodns 
SdIpuI _UN,p suUOT}eUISd smMoiowW sp ynpoid “« “"Q-"q» 
ayooidde | ap aisiqeqoid osevuuo]nueyss | onb Jnounsor 
snjd sojeys soy suep osnf ne oseuuo]QueYysd un 4n0o} 
snssop-red a 9j0LNs snjd uoTeoyHeNs sun ayloduios mb 
‘«"Q-yY» syooidde | ‘asipnjya suoae snou onb uonyejndod 
R] Suep ‘onb jsd s[qQe}IASUI UOTISN[OUOD eT ‘UOneUTUOSUOS 
eR] & xlid sop sdIpul UN.p JUOWOSST[QLId,| Mod sOUDIOFUT J 
ap jo oseUUOTHURYOS | Op soydIOYJIp JUoWTeyUOWIepUO} 
soyooidde xnap op uostesedui0s oun ajuasoid SUOAR SNON 


UOISSNISIG. °*9 


‘QMI|[IIUL 1S9 TU -ouNnvAOY Np guUOsTeI xIOYO Jed seu 
-uoy[Wueyoe | op oyooidde | aonb Jasued e asJooua yuoUUOp 
SI ‘g neayqe} np xno0 onb soagje snjd yuourTaTe19Ues JUDIOS 
s[I_nb uarg ‘stup)-s}e1q SOP SpoyJoUl kT SNOS sonUd}gO SaT]Io 
e Db ap sageoop smoyea So] DOAK TU -oUNeAOY Np spoyysut 
R] Snos sonudygo souusAour sonbneipenb sinoaue sap soni 
So] QUUOpP Z] Nes]qer} 9] ‘sou snjd satios9ye9 soy mod 

‘aystiqeqoid osevuuol[HULYde | JURJUSSSIdaI STUE) 
-sjeyq sop oysoidde | onb sjyey[nsor smoy[ioul op Jouuop ap 
anunuos Tup)-oumnerAOY np sojnG/bumxDou UOSTeUuIqUIOS ve] 
‘(guusAow onbyeipenb maid ,| sp ouToRI 39 9dA}-11899 ‘sTeIq) 
apnyoexa .p somsour sion xne ey e mb 99 us ‘suloWURaN, 


onsojeyeo ne GqX-100-ZI .N ‘epeurg onbysnyeisg 


‘b op sojuvmod sMo[eA so] yUeSITYN Ua snud}go xndo anb 
suoq Issne sed yUOS dU s}e)[NSOI So] “‘NAgId sUIOD “YsTe AA 
op uonemndod op sorpul.; e wodder sed suuskow onby 
-eIpenb MdLd,[ 3p SouloVI Sa] 30 SadAj-sjIed9 Soy ‘STRIQ So] 
yuereduios ud “g ouIeYyo ev] nod sayesi90 sap a[quuasud | nod 
SQ[NITLd SIdIpUI Soy nod s}e}[NsOI say] SUUOP | | Nes]qQe} IT 
‘Tuy-ounvAoy 9] onb tsure ‘stup)-syeyq soy nod uonendod 
Op say[eoi sosuadap say soide.p oyrey 29 ® QA9]9 snyd neoATU 
op sooIpul sop osmpoid mod uonesoidse,J ‘soatnogsuoo 
SOQUUR SION} So] Nod sayURpJONUOD saguUOP sop I1Ud}Q0 .p 
sureyioo ana mod saguUOp ap sayquiasua so] JUOUIOINS9] 
ynpor suoae snoy °“b yo '“b soqynuenb soy ans burwoow 
Iol JURpUOJ ud sIeuUl Yojngq—buiuxowu sed saguasoidos 
TuQ-sunevAoy np osyooiddey e omejuoWs]9 neoalu 
ne anbiajauoas auuackou ve] 39 (potted ev] ap sasuadap so] 
INS a9Seq d[QULIVA dI]]Ie} DdAe) “OJdd omp-k-489,9 ‘sTU_)-SIRIT 
sop oysoidde., suoreduioo snou ‘juonbgsuod seg 
‘TU -sumnvAOY Np spoyjour 
RP] B aysnfur oseyueAe UN JoUUOp yeLmod nb 99 ‘stup-sie1q 
xne 9si[jn sseuUOT[MURYSS J JoyNUIS mod sgsIyN 939 sed 
eu Inb (a}UeMOd sported ev] ap sayyUeNb soy) UONeULIOJUI,p 
uoyeslyn.. surouuesu onbiydut eyo ‘tup-owneAoy 
ne o9sl[yn sjuvysisiod soponse p UOHOU eI] 10}9]JO1 Op JUApIAS 
UdAOUL JT STUDS aJUBINOD 39 aSeq ap SapoLied sop soyyWuUenb 
sop uonesiyyn | ‘ona osomuaid e& ‘Is : o[duIs ysd Ud UOSIeI 
ey ‘buiuxow suep b ap sagjeossp smayea op uoresipyn | 
op io] 389 Jonb JOUTWIA}9P SUOADP snou ‘a}x9}U00 
Io] suep p UOTOES eI Op s}e}NSOI soy JooR[d op uty 


buiuxpu 
IsvUuUuOT[HULYII,| ANS Sagjvdop sayWUEND soap Jaq 7S 


‘Z'§ UONDIS-SNOs PR] B INapuoyoid 
ua snjd yoadse 329 suOIpNyd SNON ‘aT qeIOAR] SNdUAp suoT}do 
somne.p xnod ke s}ey[NSoI sop Uosteredwiod ey steut “mol 
® OSI JojnGg/buIwxDU UOSTeUTqUIOS Fe] B JUOWIOAneIedUIOS 
npusye JUOWASssT[gIeye UN SUOAIOSGO SNON ‘O] neoqr} 
Np ously] setup eI B sgyuasgad yUOS syeyINsI soy * (Db *_ (dD 
OIIp-e-389,9 ‘b ap sainalsajUY SINI{CA Sd] INS JURPUO] os Ud 
JOING/bulwuxDUL UOSTeUIQUIOD kB] Inod sgTNoyeo 939 yUOUTATeSO 
e souussour sonbyeipenb smoaua sop suuskow eT 

‘JOING/DUIWIXDUL UOSTeUIQUIOD eT Sp saj}9LIdoid souUOG sap 
uoneoldxe one uN .p suO;NOSIp snou “) oxoUUR,| YW ‘Smof 
-no} onbsoid yrumoy buzuxpw sseuuo]{HUeYs9 .p oumeugos 
9] aonb sajore sao JOS 99 jo ‘sapueIs snjd so] JUSWOIOTINOI 
quos soyyuenb soy sjonbsoy mod xnoo Jed xnomu of 
gUdsaIdal $9 |I ‘sayone .p UoT[HURYSE yWod Un Jed qUasoIdoI 
ong jnod ysjeA\ Op SOIpPUI.| NO OMS ve SURpP : « OIG 
2010} » op ‘ajduwis say oWIsTURDSU UN.p jeIYNSOI Oo] ‘snou 
UOTaS 4sd soUUOT[HULYSS JUSWONbIVeUIg}SAS JUOS syUR}IOdUIT 
snjd soy] smapuca soy onbsioy (yepiodns sorpur jno} 
‘uawayelpul ‘ouop 39) Ys[eA\ ap UoHLndod sp sdIpul.| 
Ja{qio assind jojng ap uoT[HuRYdE,p sorpul.| onb yey oT 


UO|}EWWOSUOD P| & XIUd S8p Ssdipu! $9] Nod aHepuos ap suejy : uewWwHAa/A }8 JaAeE] ‘JUd7] ‘UEWLOG VEZ 


andoyejeo ne Gq@X-[00-ZI oN ‘epeueD onbusneig 


8r'I S80 ZO‘I O7'I Le] 69'T cr I 9ST 
OCT 99°| 6r'I Cs 96°€ L8‘I 8S‘Z £07 
Ly Zr Oc T LS cre LEI I¢‘Z OL'T 
LOT tet 07'T ima SOT O¢'T €0'T 71 
Ciel ZS el Oc T 6ST 60°€ 8ST Sia 8ST 
L6°0 Sol 60'T CT 66 ab I v6'l cel 
960 Ci I Pht S01 80°T ri‘T 90°T 
LOT OCT eT Srl LOC Sor | O1‘Z trl 
€6°0 Ail 90°T cc ft v7T Coy Cot St | 
00'T 00'I 00'T 00'T 00'T 00°T 00°T 00°I 


00-66 66-86 86—L6 L6—96 00-66 66—86 86—L6 L6—96 00—66 66—86 86—L6 L6—96 


p adn ¢ adn 


I'l Gil “Oak ral ai sarnonigque b *huruxpujjoing 
SO Su WOO? sil iGowncGe Addi We 
CSC Gr, CCCs Lae 4s1dd/NX 
vit i ac at | DulwuxDuU/IN 
Clann GCC. Lor. CA-"a) 4riddjanbyauogs auuadoyy 
BEC 861 88° 80°Z ' asyddjanbiayauoas auuakopy 
90°T OL‘ Ol‘ OZT buuxpu /anbiajauioas auuadopy 
PTC MAG OLC. fbc avyddyjojnq 
LO" Heres Vv OL Teeter 4sjddyoinq 
OO ThemnOOiF mnt00 im OOM (A-U)bunuxpupjoing 


ss vUUO][MULYOS .p 9poyjout/ANoyeUINS| 


Z adn 


g ouTeYo ‘soyInpos suotjeindod “Any sap s]quIdsuad | Ins sANRTOI UUDAOW OnbYyeIpenb IndII9 | ap s9sIpIepuL}s suUdAO/\ 
OF NesTqeL 


‘aseq op opoliod ve] e sasuadgp say Ied s919puog x. 


950'I 9r0'T —- 8h0'T 
8660 L660 L660 
060°1 O80T  —- 160°T 
ZOI‘T 160°. — OOT‘T 
9960 $960 660 
€r0'I 6601 PEO 
8S0'T 9501 SSO 
7660 0L60 7960 
6L0°I CLO Wyume CLO 
060°1 6801 —_ 880°T 
0S0‘I ZrO'T = 90 
S10‘I SOOT L660 
SZ0'T ClO stem O0Gt 
780°I Z80°T ~—-O80°T 
Or0'I OfOT 8Z0'T 
YSTeA\ Op otteuOUIDTD «=—sysyeAN OUST 


Q0IpuUl | op soiAadseT 


LOI 9E1‘T eh — SeTeUIpIO 
O€0'l 8r0'1 CY — SoteulplO 
I9T'T ical Tp — sodreulpiO 
CLAS Sel Ce — SOUNA, 
766 0 €00°T Te — Seguin 
160°1 il ai €7— S99N$ 
Cr l I L81‘I CC — 892I9NS 
Sr0'l 980°1 TZ — Se9Iong 
€Il'T poll cl — sepney) 
(iS i ii ESIyh TT —Sepneyq) 
SUOTIDIS /SOPOTUIL .P SayeNS 
1OT‘T Sell SoMeUIpIO — 7 
rS0'l 780'1 sop —¢ 
880°T 6CI'I sopDNS ~~ 
Slab I9T'T sepreqy= | 
sodnois spuein/so10s9ye9 
160°1 671'T SopoTe Soy] sno Ll 
yanbiajauoas saikodsey uondiiosaq 
auuadopy 


8 SUIRYD “9661-S661 UONLTNdod op seorpuy 
6 heo[qe 


‘Told ourgUT 9] SIATNS 
B QOULPUd} JUSTRAR (SQUdSIId UOU) s}eINSdI So] 1d ‘SOOURLIVA 
So] JO SIeIq Soy oIpM|d yuoWTesd suUOAe SNON yong 
Op SOIPUI.| 19 Dux sseuUOTTHULYS | OUD dIQLIOAR] 
dISIOUAS SUN d}STXO [] “SONI sap ouuddour vy onb sovoyJo 
snjd ysa anhiyawuoas auuakou et anb 3 ‘anbiyauioas 
auuatou et onb sdvoyjo snd yso jojng a (zZ aonb jo 
(dop)uxjdd anb maypiour ysa (‘dap ydd anb 30 “(‘dap)\dd anb 
I[[IOW 3so buiuxpu ({ onb Jasuad ve yUoUUOP s}eINsaI sad 
WY 2 onb sjeynsor smayfioul op suuop mnb ‘anbiyawoas 
auuatou ev] Inod onb jojng a] Mod smoyypIow JOS syeyNso1 
so] ‘sod suondsoxa sonbjanb e.nb suoyejsuoo snou “(O] 
nes[qey ne “aja “g yo ¢ ‘7 sind ‘7 39 p ‘T sousT] soy yueIedu0S 


CEC 


Ud) OXY oseUUOT]HULYDE Pp spoyj}oU ev] SUOUDJUTeUT snou 
Ig “SOIMOI[IOUL Sd] SUOTNIOS Sop SUIOTXNp PL] 3SO ISTUIOI sus 
jdd sseuuoyHueyos J ‘ajqeiooidde oS.1eur oun ddAe JUSANOS 
‘oyqrey snyd ey wba J suuop buuxpw “(0007-6661 “€ 2d) 
sgid uondaoxe oun e ‘adn onbeys mod ‘mayeunjsa onbeyo 
Nog ‘JOjNG/buluxoU UOSTeUIquIOS ey] Inod suuaAour wha J ke 
yoddes red souusXoul sa9 ap one d] SUUOP QT NeaIqQu} a] 
‘adn onbeyd suep uoneulnyse 
joseuuo][nueyos p opour onbeyo imod soagmnoyes 939 UO 
ANY Sop aquiosua | ins wha sap souuskoul say “AN F.] op 
NvOATU Ne YsTeA\ SP d[QIO soIpuT UN ve YOddex red suoneuUIyss 
sop suusfow onbyeipenb moo] gynoyeo suoAe snoN | 
‘suOTIHUYDS QOS 919 SUOAR snoU ‘“FZAyP/adn UOsTeUIqUIOS 
onbeyos suep ‘oaseuuo][yueyoe.p opour onbeyo smog 


900Z auqws_o—ap ‘ajenbus,p senbiuyos | 


‘OSTUUDI 
JAB UOISIOA Pv] ONb sfqQviueA suUTOW jeJOs [I,.nb suormuosdnos 
snou onb dosed ‘aster sues jdd oseuuojyueys9 | oipme 
yUOWOTeS9 SUOAR snoU ‘buluxDU 49 “(QUTeDTIOUIe oYydoIdde | 
SUBP SLUTS) asTtUar daAv Jdd aseuUOTTHULYE | ONGC ‘(eyed 
loud opnjd.| SUP SWTUIOD “a9UUSS O.9,P NOI] Ne) snUUOD 
yiejo (sasuodap) ate} op sjqeiieA ey onb gsoddns suoae 
snou ‘djU9A op sjuIod say suep soporse sop odeuUO][HULYSS | 
suep sind ‘ajuda op sjulod sop jdd aseuuo]yueyos | sued 
(YW) soner sop suuakoul ey 39 (SUOADL Op ddIpUT sgjodde 
Issne) ooispuod uou anbiyawoas auuakoum ey ‘(joing 
31) (NY) sonbyoumjiie souushoul sap ones os] : SoureyUSU 
-9[9 SOOIPUT Soy] Mod smoyeUISS SION ssT[IN SUOAR SNON 
“) OxOUUR | B SUONISIP snou 
yuop “InoJeuTUeXd UN.p dsnarIonjse UONSossns oun kv ddBRId 
Ys[eA\ Op Jepiodns sompul,] SIOA JOYS Op SOIPUI.| sp UOT} 
-uayye aou suoseldap snony ‘(bumwuaxou a1 aouUUOTIOdoIdsIp 
uosey op Joouonyur wermod uoyyueyos,| op uononpel 
eR] onb Joustnos op outed ey yuoWdqeqoid yneA I “WWoATNS 
Inb syeynsel say suJa0u09 Inb 99 ud) yUOWOLIedde-onol un 
STUJod UO Q SUILYO BI Ip SJUSWIANSISOIUD Sop % (6 UOMAUA 
212 ‘8661/L661/9661 “L661/9661/S661 Mod ayuea op syutod 
So] suep sofome sap xud soy Joseduiod mod soguue sion 
ms yuoworedde | omp-e-}s9 9 ‘« yUoWoLIedde-o.91 » UN JU} 
jourlod saporie soy aonb omypout,u op uye (‘22 ‘1661-9661 
‘9661 —S661) Seouue.p omed sun mod sayquenb soy 30 xd 
Sd] INs ssquUOp Soy UNDKYO JULUDUOS ‘xNeUISLIO sogUUOp op 
so[quiasus buro sa] ynpsl suoAe snou ‘samoatigjue sopotiod 
sop ins seseq buuxow syooidde | Jorpmje Mog ‘ayedriourd 
opmd,| op seo a] suep CQ] ke Uosoddo sed ‘souuoNsoTes 
919 yUO (OJU9A op yulod sed ojonse un) aUdA op sjulod 
¢ Yyojuasaddad ajoyAo/ANP onbeys mod “Y7NP/S}yeUes 
-91da1 Sopome 67 30 ‘SopOTe Pp Sayes/suoTses ()| ‘(SosTeUTPJO 
30 SogyINy ‘sdarons ‘sapneyd) sasuadap ap sori0s9ye9/sodnois 
spurs p ‘adn ¢ : SUIQUI BI 99}SO1 ISO ASeq Op sINjONs VT 
‘SJUSUISISOIUS (IYO 9 UOMAUS 
ylos Uoneindod ev] ap syquiasud J ap % QE UOMAUD s9UUL 
onbeyo jueusiduo0s ‘sasrpmye souleyo sop spueis snyd vy 4so 
Q oUIeYD BT ‘SOJUSPIAD snyd jUOIJOs sonbasuLyUT sooUdIOTJIP 
soy onb azJos op ‘outeyo 93399 suep suasoID}0Y4 snd 9] JOS 
xd sop JuswWayIOdwo9 9] onb 99 eB sIpUdL,S Op I[QuuUOSTLI 
yso [I ‘ayno uq yong 9p sorpuT oyduuts a] onb senbrydwos 
snjd yuorej}9 TU)-ouNeAOY Ne SOST[IIN SoITeJUDUII[S SooIpUl 
SOP SINICUIT}SS say ‘souTeYO sane say] nod ‘onb sored Issne 
STRU “Io19s & a[IOey sn{d ylos apnje,, onb mod tsure spgoo0id 
SUOAR SHON ‘9 auipYo ‘syuepUddepUT sUISeSeW xNv SUOJUT] 
snou snou sieul ‘(sfissaoons JOWAgJ op siour) oypediound 
opm9,] mod sogsiyyn satjao aonb soayessg0 say Ins soguuOp 
SOUIQUI SOP STAIOS SOUULUOS SNOU SnoON ‘UoOHRNuIIs Jed sopm9 
Sone Pp 9]Nd9X9 SUOAR snoU ‘suOTjsonb sad JoJO[dxe Mog 


IATVJUIUII]O NVIATU 
NY SANIJVUISI 19 ISVUUOT[HULYII.P SOPOuWII =-['S 


ansojejeo ne ¢qX-100-Z] .N ‘epeueg onbysneis 


‘QyUeNOD apoLad vy 39 9seq op spotoed 
RB] op onb yoynqd ‘azuapazaud apotiad ke] ap jo aseq op spotted 
R] Op JueUdAOId soguUOp sop Ins spuoy yso bumuxow sseuuo] 
-[Hueys9 | onbsioy assed os nb 90 JOUTUID}9p Op JURSSdID} 
Ul JUSUATeSS vIOS |] ‘odeUUOTTMURYOS Pp spoyjoW eT OX 
SUOUdJUTeUT Snou onbsio] JUoIedUIOD 9s SoJIRJUDUI[9 SOOTPUI 
Sop SIMI}eUIIsa soy JWOUTUIOD (Z 39 ‘SOMLIUDUIITS soOoIpUT 
Sop INI}VUIT}SO | Ox yURUSJUTeU UD “ujdd Jed gQyUdsoIdoI 
aystiqeqoid oseuuonueyos | e oreduioo os (bumuxpu 
IMS 9Seq UOISNIOUL.p [Inds doAv SSvUUOTTHULYDO “‘ToL) asnl ne 
SseuUOT[HULYSS | JUSS (] JOUTLUINOp eB SUOYDIOYO snou 
‘QUO *xnNep soy No ‘UoneUIYSA | Inod sassITWN soyNULIOJ soy 
aU NO ISLUUOT[HULYOS Pp SOPOYJOW Soy SUS SadUdIOTJIP 
sop & SMP JOS s}ed9 Soy IS MOAKS ap uONsonb x sy9AN0 
QSSIR] BIO sIeP, ‘UOHe[ndod ap someUsUII[a sooIpUT sop 
UOT[HURYOS Ins UOTYeUITSO | e JUST] onbruUeILIG 39 OUTeOTIOUIe 
sopoyjoul soy Jed souuop syeynsor soy aud soUdIOJIp 
eB] Op ajuvpodul yuowsqe[quiosieslA somos oun ‘oUOC 
‘O[GUIDSUD UOS SURp SOIPUT | INS & SOIPUT | op UOTON.sUOD 
ap sfqrey snyd 9] nesaru 9] onb JIstOOp JOIFO | OSNITI “6 NeaTqQe} 
ne soyuasoid syeynsol xne onsnfuoo ‘gq oxouue] e gsodxa 
ajduisxo J (6661) ‘[JOo}8 UeUyIoq onb Isule ‘soousIgyor 
SQ] 10 (PONT) HOMIIC] JOA LonUUOdII JUSUTDTVIDUIS 4S9 SoIe} 
-UDUI9[9 SOIPUT Sop UOTJONSUOS sp spoyjJoUr eI op souLyIOd 
lJ ‘uoneindod ap sasuadap sap sayjoor syed soy yuestpyn 
Ud ‘sagJapIsUOd sTqQIey Sn{d NeoATU ap suoTdo soy soyno} nod 
JUSWIDUIOJIUN. 99}Nd9Xd BIOS SADT SN{d NedATU Op SOOdIpUI 
Sop I9}qO,p ona Ud UOnLSoIse J “SUOISOI Sop IMOLIDIUL | 
B SOMCJUIUII[D SOOIPUT SOT SOTqIO sUOD yURUSId UD ‘suoNdo 
SOSIOAIP SOP S]PIOI sosdeyURAR SOT SUOIedUUOD SNON ‘sore} 
-UDU9]9 SAOIPUT Sop SdTNUIOJ Soy ‘() IMs 39 OSeUUOT[HULYOE .p 
(ANV) juejuosoidol oporte-uiseseul neoat of ‘(¢) IMs 
OIIP-8-}S9 9 ‘SOIPUL.| 9p UOTON.sUOD op sIqIey snjd oy NeoATU 
3] IMs suoMUZOUOD snou snouU ‘TAINS op opnNja] sued 
‘gsnotia}sAur nod un amouwusp Uoyes 
-9188 Pp dAdTa snyd neoAtU ne yno-ms ‘syyRpJodns sooIpul soy 
Jg{qQIO & soURpUD} B TU-dUUINAOY Np SdIPUT | 9p IM9}eUIT}S9 | 
gjjonbey mod uosie1 vy] UONdEs sIOTWIOp eI B QUUOTUOUT 
SUOAB | SNOU SUTWUOD “JotfnonJed U_ “SoIpUT,| op UOTON.SUOD 
ap onbruuryig 30 SUTROLIDUIe SOpoy}oW sop JHeIOI oILISU 
ne onqiyuos yedse onbeyo omsour oyjonb suep JOUIWWIS}9p 
OP I[IOYJIp OUOP sd |] ‘SOMeJUOWI[S syeSoIse Sop s[NUJIOJ 
®] (p 32 SoIsop SIOAIP & OSeUUOT[HULYOS Pp 9pour os] (¢ “UO 
-elopuod op 39 uonesose.p simonns ey (7 ‘esi[eyUs oseu 
-UOTTHULYOS | ap ‘oOIMSOU oUTeVIOD UN sUEpP ‘Jo SUISeSLUT Op 
SOJENS SooIOTJIp op up -ounevAOY ne uoHesiyn | Joynonsed 
Ud UOHROyHeYS op sons vy] ({ : spsesa onenb e yuoIgTJIp 
STU-sIeyq sop jo Tup-oumerAoy np soysoidde say] 


IAMS op apnjyqy *¢ 


UONJEWLUOSUOD ke] e XIUd Sep SedIpU! Se] JNOd eHepuos ap sue} : UeWHAa/, Jo JaAea7] ‘JUa] ‘UEWYOG ZET7T 


andojeyeo ne GqX-100-ZI .N ‘epeueg onbusneisg 


Le? 


10L‘0 S18°0 179‘0 6€8'0 8L9°0 Cy - Sosreurlpio 
S00°T 760°I eg I1S‘0 790 Cy— SoseurIpiO 
LIC‘ L9S‘0 p6r'0 €79'0 60L°0 Ty— Seiteurpio 
9S¢0 LSv‘0 vIe0 608°0 €89°0 ce — Sop Hn 
819°0 18¢‘0 L¢€9‘0 6S0'I 8LL‘0 T¢ — Sopyiniy 
1S8‘0 $76'0 8rr'0 ssr‘0 0S9°0 €7 — S9QIONS 
S9e‘0 Ive O8€0 9770 7601 CC — S99IONGS 
O€€0 S6S‘0 1tr‘0 Z6E0 ZOL‘O Tc — S9ptong 
7r8‘0 098°T 691 ‘I 0S8°0 07%6‘0 cI — Sopney) 
80S‘0 67S‘0 789°0 990°T €76'0 TT — Sepney) 
SUOT}IDIC/SOPOITIL Pp SaIeVIS 
v0r‘0 610 LLL‘0 L670 O10 SoTeulpIO — f 
Sor‘0 10s‘0 80€'0 806°0 56S‘0 Sopun yt — € 
7870 7S‘0 vIe0 9E€0 9870 SopION§ — 7 
685°0 Lev'l €8r'0 LIS‘0 €IL‘0 sopney) — | 
sodnois spur. /sollos9ye9 
8870 8rS°0 6170 7610 9610 soponie soy sno], 
0007-6661 6661-8661 8661—L66I L661—966I1 9661 —S661 uondiiosaqd 


‘NA Sep WO 1B ‘N-A OP WO el 9p soney 
8 neos[qe 


‘O01 = S661 “JOHAQy 8 JOLIAQy ap SOIpur | 


dP SUOHRUIISE Jo SSOIPUT “JoYsI.J op UoNe[Ndod sp saorpul say 19 sonbruuezg suOLUMSO so] o.WUS SsOUDIALIG *L sans] 


0007 


SIMVUIPAO 9¢—. SI9JIMAT —sy— SIVIING — ge. sapneyD —@— 


aquuy 


6661 8661 Lo6l 9661 Sool 


T 
\o 
gouasgIid 


‘OO = S661 “OMAgy 


B JOLIAQJ OP SOIPUI,] SP SUOTVUSS J9 SOIPUI ‘soTeaI90 Sop s]qQUIASUD,| INod suONeUIYsa 49 saqqIO soorIpUT ‘9 oaANSIy 


AU SA —s<— "NA “ISA —y— onbiygui0gs ouuadoy] —g— s0ys1y —@— 


0002 


aquuy 


6661 8661 L661 9661 S66l 
1 1 1 4 + 08 


9002 eiquiaoep ‘a}enbue,p senbiuyoe | 


andoyeywo ne Gd@X-100-ZI ,N ‘epeued onbrsneis 


1700 €70'0 8Z0'1 190°0 7v0'0 LOTT 790'T Ep - SoMvUIpPIO 
7£0'0 T€0°0 L860 1S0°0 S€0°0 €€0'1 9660 Cy— SoTeulpiO 
6r0°0 0£0°0 090°T 0L0°0 0S0°0 690'I 1Z0'T Tp— SetteulpiO 
1L0°0 6S0°0 LLO'T 0m) 780°0 SLIT OITT ce — SopHnT{ 
L700 020°0 7£6°0 S¢0'0 070°0 6L6.0 0S6°0 Te — Segyinty 
6£0°0 L700 970'T 090°0 7r0'0 $60'1 rS0'l €C— S99INS 
IZ10 0€0°0 680°1 IIT‘0 1S0‘0 OLO'T 7L60 CC — SgDNS 
vL0°0 S70'0 0S8°0 9010 0S0°0 700°T 0160 To S99- ng 
Lv0'0 Se0'0 L70'T 1S0°0 6r0°0 7LO'T 8s0'T cl — Sopney 
7£0°0 $Z0'0 790°T S¢€0'0 S€0°0 Sv0'l ry0'l TT ~sepneq) 
SUOTIOIS /SIJOILIL .P SAVIS 
910°0 910°0 SZ0'I 100 $Z0‘0 ZLO'T L70'I SoMeUIPIO — p 
re0'0 L700 986°0 850°0 S€0'0 €S0'T L00‘T Sound —€ 
L70°0 €70°0 1L6°0 560°0 0€0°0 9r0'T 956°0 pops ¢ 
€70'0 7700 Sr0'l Z£0°0 1€0°0 6S0'T 7S0'1 sopney) — | 
sodnois spuein/so10s9yea 
Z10°0 110°0 Z00'T 790°0 910°0 LSO'l L660 SofOHIe Sey SNOT, 
WOdy odAj-yreoq = ouuaKoWY WOTN odAj-yreoq = ouUaAOJ] d]QID SoIpuy uonduosaq 
AY 1A 
9661-S66] S2dIpur soy Inod suoneinums sap syeyNsay 
L neaqey 
STII 790'1 €90'I vOr'l EV SoueUIpIO 
0SO'T 9660 9660 Oc0'T Ch — Someulpio 
760'1 IZ0'T IZ0'I L90°I Tp — Sotreurpio 
p07 T OIT'T OTT Soll ce — SOSHNIA 
$860 0S6°0 $S6.0 LL60 Te — sopynyy 
6II'T vS0'l 7S0'1 €60°1 €C— SepDNS 
€60'1 7L60 7860 €90'I CC — S99-DONS 
veo'l 0160 L160 €00°T I¢ — Seg png 
L60°1 8S0'I 6S0'1 €LO'l cL Sepneq) 
LSO'l rr0'l rr0'l €70'1 LT — Sopneq) 
SUOTIIIS /SOJOIUIC.P SVN 
760'T L70'I L70'I 690'I SoMeuIplO — 7 
L90‘I L00°1 L00‘1 rr0'l Sop — € 
ZLO'T 9560 7960 7r0'l SopDus—7 
8L0'I 7S0'1 7S0'1 8s0'l sopneyq) — | 
sodnois spuein/so110s9ye9 
6L0'I L660 Z00'T €S0'l SOpIHIe So] SNOT, 
anbi4jauoas 
sorkodseT] Joysty SIADUIO auuadopy uondriiosaq 


Sa[qissod so]qlo 9661-S661 SSOIPUT 
9 neslqey, 


‘QWURAINS UOT]IES BT B UONSoNb 93399 
Ins suoysued snou sno “Mepuojoid us snd sagipnys o.9,p 
JUD}LIOU SOIpUI JO9 JoWTXOIdde ev soURpUd} Md] op suUOsSTeI 
So] “IOYSt{ Op SOIpUl., eB JWOWIOTTOUUIOJ sed yudTqQuUIOSSoI 


ou sonbruurjiig smoayeurnss soy onbsing ‘steiq 9] yWNpor mb 
99 ‘syuepuodsa09 JOYS! Ip SOdIPUT Say] JO[qIO eB sonbruuyyLIq 
SINSJEUISS sop suUPUUO}S soURpUd} oUN ke ‘aed US ‘np 
JUSUIDTLS9 JS9 BIOO ‘SUIOLTURON “SOURLIRA Op SUTOU ‘JURUUOS 


UONEWWOSUOD ej e XIId Sep SedIpuU! Sa] JNOd eHepuos ap suejY : UeWIBA/A 8 JOABE7 ‘Jue ‘UeEWULOG OFZ 


ansojejeo Ne FqX-[00-ZI WN ‘epeueD onbnysneis 


sed jsou mnb 90 4inpoid mb ‘(uoT[MURYD9,, suep JoNUO 
yusAnod nb sapnie.p squiesusa,, op sMoyeg[e uoTdeI9S 
ve] onb jueusieyuod snjd yUSWIOTQISUdS }sd UOISNOUI.p 
[Inds oaAv/suUOSIeI xIOYyO Jed aseuUOTHULYDS | onb sdI1ed 
yuowioyediounid) osjyorns snjd oaseuuorHuRYysS.p omjonqs 
oun e ‘aried ua ‘ayqengije 4so eja_q “SUOTIVUSO SOMO [TOU 
quowioyou op juasinpoid tup-oumneAOYy np sopoy}sul 
So] ‘[e1ouas ua ‘Uepusdad ‘souUog suTOW yUSWIOTQeIOoId 
-de yuos sonbruuryiiq suoneumss soy ‘aja[dut09 « sapneyod » 
aliosgyv9 ey] mod ‘Uonbgsuod sed 4o « sapneyd» ap 7 
uoT]IS B] INod ‘NO 6661 — 366] SOIPUI So] SURpP JUOWUTUTR}OU 
‘soyeuioue smoyeA sonbjonb yuayuos [J ‘suonoes say mod 
yo sadnois say mod ‘saponsze sop o[quiosua | sod ‘saguur .p 
soiled buto soy nod ‘stuy)-syeyq sop aqfoo eB Tu -ouneAOY Np 
suusXour onbyespenb MOd,] ap d9IVO OUIORI BI OP ONRI 9] 
auUOp g Neeyqe} OT “sTUP)-s}e1q Sop xnod onb JOYS ap a{qIO 
JHeJodns sorpul.| op suoneuryso SoIM]]IOU ap JWOssTUMOJ} 
Tupj-ounevAOY Np smoyeurnysd soy ‘ayquuosud,] sued 
“SolIo39ye9 ayenb soy aoa ye 
soyusd9I sn{d say] soguUeR Soy SUBP UOTPUIT]SOIMS ev] B DOULPUd} 
ev] onb a[aAgI UOWeXd UOS ‘solIOs9}e0 anenb sap sunoeyo 
Inod ‘“IdYst{ 9p SdIpul | 9 oyNe | Ins s9uUe UN Pp souUUdAOU 
sonbruueyig sSuOTeUIQSd soy aNUd sOUDIAYIP ke] UUOp 
L omnsy eT ‘squasoid sed yuos ou 39 anbiyawoas auuadou 
P] B JUSUIOATLIOI SIU] -S}e}q SO] INod soyqey{quuas syO} JWUSTe}9 
(‘aja ‘« sapneyo >>) sallo#ye0 so] mod sjeynso1 soy] 
"Soagya snjd ua snyjd op xtid sop yuonbyesd mb sutseseur 
op sodnojs suieyiso ms JoNUdDUOD snou kB NO xNdNo0d 
syyeyuasoidol soponse Soy JoUUOTTHURYOOINs eB JURUOUT snou US 
ano-jned ‘souTvoLIUe SUOTeUT}SO soy Ins onb sonbruuryiiq 
SUOT}PUIT}S SO] INS spuvss snjd souaprour oun yuaTe sasuadap 
Sd] Ins sogutiad saguuop soy anb ynod as [[ ‘UoOHeUINSd,] 
yo osvuUOT]HULYDE,,| mod ‘cgG] mod saguUOpP sa] MOARS 
e ‘soouttied snjd ua snd ap sasuodap soy mms saguuop sep 
QSI]IJN SUOCAR snou onb JOUsI_NOS op JWdTIAUOD [TT ‘UOTYe;ndod 
op anbiyawoas auuacou ej op onb IJOYSLJ op ddIpul,] ap snyd 
yuowoyou syooidde_s [1.nb uargq ‘sayuso91 snyd say soguue soy 
suep xld soy JOUN}SOMs B DOUEPUd} B “IOYSI{ Op SOIpUT.| jINs 
mb ‘onbruueryiq moyeunss,JT uoyendod sp anbiyawoas 
aUuUadOU FB] SIAINS B DOULPUd} & UTBOLIOUIe IMd}PUIT}SO | 
aonb MOA op oloery yso YT (Ss & [ SomMBY sol jo g OMB vy 
OUD ITJOYI,P SOUdIO]JIP vk] JOUSI[NOS op JUSTAUOD ]]) ‘JUep 
-uodsai09 onbruuryig 30 UTROLISWIe SsIMdyeUUSd sap suOoT[n 
-UeY99 Sop d[qUUdSUd | Ins souUdAOU Soy onb Isure ‘saguue .p 
somed buto mod sajonie sap spquiasua., nod one] Is 
souUe OUN.P JOYS Ip SdIpUl.| 39 anbiyawoas auuadou. eI 
ouUOp 9 ANS eT ‘N00T— 6661 &.Nbsnf soguue .p saatssaoons 
somed soy Inod snudjqo 939 JUO SOIIRIIUIS syeyNsel soq 
‘syey[Nsor sug sp uouUOp (sked sanne 
XNOIQUIOU op 32) TUpj-owNPAOY Np *« ayNIG ddI1OJ » B 
‘QUUOSTeI XIOYS Jed sapoyyoU soy ‘opnyd | suep sasTTyN 
xnoo onb sj9} syeyoe.p uoyeindod oun mod sutow 


6272 


np ‘onb ospuqjus yWOssIV] syey[Nso1 sou ‘sUTOTURON 
‘JOYS op doIpul uN.p sieiq sues uoNneUTxoidde 
oun ouuop ji.nb sosued e sed yeloytod ou oULIOJ 
BS SIBUN ‘oTqrey snyd soURLIvA oun ayUasoid sXked 99 op 
Inoyeuryss | onb yueuuo}9 sed jso.U [I ‘TU-suNeAOY 
np oseuuo]Hueyos .p urd np aUTaNsoI JUOUIOANPIOI 
omjeu ev] QUUOP jUR}A “SIUP-s}eIq Sop IM9}eUINSI | 
ap oqJ90 aonb syqrey snyd JuaUIoyoU ys0 Tuy -ouneA0y 
np sIMoyeuryss.,. op suussout onbyespenb modo] 
ap 99d sUIOBI RT “UONOOS BI Op NKoATU ND aWaU 
‘Q[QID SUMUOS JOYSI IP SOIPUT.[ SUOSSISIOYS snoU IS (¢ 


(‘UOISNISUT Pp [INIs ddA SUOTTMULYDE ,.P 
UOTLSIISL | IP SIO] DILIIUIS yeYNSOI UN QJOU B (8661) 
ugeq) ([ no 4 syueyrodns saorpur sop soyooidde .s 
B JUDUID)SOJIULU JUIOUSUTUUOD SUONRUITSS soy ‘saponIe 
sop ds[quissua | op 30 odnojs pueis np xneoalu 
xne nbsnf uoneseise.| suoamsmod snou onbsioy 
‘slojanoy, ‘2a ‘synepiodns saorpul soy onb osyqrey 
snjd ysd Z] UoTdas eT Mod sorpul., onb sipuey ‘7 
a]qIo ve] onb sagq9 snyd ysa [[ UONSS ev] Inod sorpUul | 
‘gjduroxe sed ‘sayuepuodsaio0d sajqio soy 3a UoyIas 
e] op neoaru ne sonbruuryiq suoneumsea soy onuo 
OMe]O dIPIO.p UOHKIOI ouNoNe JOYSIXO s{qQUUIDS OU I] (Z 


‘UOTOOMIp sug e] Sup sed UN aJUasdIdoI 
ILUDUZ[N UOHSoISe P IpOYIOU 93100 B STUP)-S}e}q 
sop osessed oy onb saanoid souteyie0 ouUOp ynepiodns 
Q]QID SOIpul,| 39 sosAodsey] op ddIpul.] oud onqIS 
aS H onb yey oT ‘(soaga snjd uonesoise .p xneoalu 
so] Inod saiAodseq] op aynusoy oun 9siyn suoAe 
snou) JURUTWOp jsd UONeSIIse -p s[qIey snyd oy NeoATU 
gj onb mMoaes & “(666 “T]09 39 ULUIOG) JouUOSdnos 
yey JUOTRAB snou xneAR sayne,p onb oo suWMIUOS 
RIIQ  °H anhiyawoas auuatou ey op sJoyooidde,s 
JUDTQUIDS SOUTROLIOUI SUOTILUISO Sa] ‘SopOITe Pp saye.ys 
Sd] 39 SdLIOosg}e0 soy ‘sapose sap s[quiesud | mog ({ 


: SUBAINS SUOTIE}L}SUOD Sd] SUOSTT SNON 
‘JOYS op soorpur xne yodde1 red sgmnoyeo so ouUdAOUI 
onbneipenb moo, no ‘sonbruuryiq 39 soureorioure suon 
-eulsd soy od sayuepuodsaxi0s souussoul sonbyespenb 
SINdLID 19 soouRLIeA ‘souUdAOUT So] OUUOpP / NeeIqGQe} OT 

‘[ UOTDOS BI B JUOINSTZ Nb sayqid sa] Ms UOTSsNd 
-SIp vl suojoddel ‘piesa yoo Y ‘souUOp jUOS ‘UONeUIYSA | 
Op SoTqIO soy suo sa1gpIsuos 099 JUaTe.LNod Inb ‘saorpul 
SEN) ‘SUOTIO9S/SOPIIe Pp Sayv.YS Ud dSeJURALP 9109 99] 
-U9A (¢ 30 SodnoIS spuRIS/SdSSP[D Ud ddTUDA (Z ‘(SauTquIOS 
SOUTLUIOP SIO. SOT) 9[QUIASUD UOS suep ({T UOHRndod vy] mod 
9661 & S66] JRIedUIOD sadIpUT soy DUUOP 9g Nee]qQR} IT 


ajediurid apnja,] ap syejinsay*p 


900Z auquiesep ‘ajenbuae.p senbiuyoe | 


‘a]qrey snjd a] nesaru 

ne oeniqie soucredde ud jo g19puod uou moyeurnysy 
Ld9St[eyUI UOSe] Op SOAITOI 

xld sap uonesoise | op seo a] SuRp 9JUR}SISUODUT 
uoneiapuod ap sjudtotJo0o op oyeredsip ayquiasuq 


(souTeyo Ud UOTWLOTJISse]O B] Op ‘dIIP-e-}Sd ,9) 
SUISESEU Sop UONROTFeIS eV] op o}dwoo sed jus oN 
UOTIOIIIS B] OP SIO] o]JaNjJUDAE UOTNEdaYy 


so[qiey SyuIOg 


ansojeyeo ne GdX-[00-ZI oN ‘epeuro onbysyeisg 


SOdINOS SOSIOAIp Ins orndde .s 
suUISeSeU Sop soidne Ule.119} 3] Ans aJonbus 7 


9]U9A op sjuIod sop uonRoyNeNs 
« 9JNIQ 9010} » op odiouud 9] ans oindde.¢ 


s9gst[euLiou snyid oyfouuoneiedo sinpsd01g 


a[qrey snjd 9] neoaru ne (q@q/) soyeuorse1 
SUOTJLUUT}SO Sop sogpuod sinayeutjsa sop ouUOG 


esevuUO][HULYd9 | op onbissejd a11o09y} ve] WeysyeS 


UOTJULIOFUL | Op UOTWSI[HN opuess snjg 
uOneUIOJUL.p snid o][Ionsoy 


SLIOF SJUIOd 


onbruurjiig 39 suleoLigwe soysoidde sop uosiereduios 


g¢ hvo[qeL 
rt I ro) 
(4 g aS = Mla 
a ul 2 2 K Yi 
2 Vv 
‘ ay ln OC = of mero! uonedeise .p 
41> Y] Ago snyd nesatr 
tical was SA9]9 SN] SAIN 
a yal O31 y sa(f‘r) 
te NEE reulig) “30 
BULL FE OE OH A pp 
yal 231 u ~ yeede “al ull U = waa STR} UST]? soIpuy 
104} atlig\ 144 
Ae x a — 
[ ‘of, , ff 
(Ga? “bya |xewt //1 919ueA | (°la 1° a) add ofp ajonse | 911039]e9 oUuN/a}UDA 


o<°l7 


‘y UIseseU ap 9dAj D9Av SYA —] UOIS9I x 2 


Jneyssgidal sponse //ayUsA op syutod g 


(491 a) stupjsodun snjd sary 
/ UOIS9I/Y UOT}OeS/9 syIeyUasgidax soponE Z 


“LA (TAY) Suiseseur sop soidne ajgnbugq 
ie ae 
sod sod 


I 


1adN x 2 ANV//oque op sjutod g 


1 Adf/Y Seppe p syens/9 ANV 7 


op juIod un suep spony 


Clq (lq) aojdd 
9]U9A op syutod sap x1oyD 


spore .p 
SO11089}e9 Sap xIOyD 


(coG/ cg) avid 


311039}89/]USA 
op jutod red sasuadaq 


"Ia (SdOd) seBeusy 


soseugu sop 
sosuadap soy ins syonbuq 


7] 
cod 


1a 


Tu()-ouneAOY ne jo stup)-s}eyq xne soanbijdde sopoyjeur sop orreumwuos uostereduio0g 
p neoqel 


‘2OA9|9 JUSUUTUIONbgsUOD UONeIspuod IMs] 9p asneo 
e YIp yuouonNe ‘sasuodap sap dAd]o JURJUOW Np UOSTIeI Ud 
xXUd sop SdIpUl,] JUOUS|GR[QUIOSTeIA JUOJOUTWIOp smmapusA 
xnediouud soy ‘soyqeiquios susiq anuo omeA xd sop 
OULPUD} LJ IS OUOU “NaT] SUWaTXNep UY ‘o]duexe May oJAINs 
op oynsnf no omessad9u sd ]I.nb sasuod yusanod souls 
susIq sop JUepusA sjuRyJoduI suIOW syUaLMOU0D smd] 
‘xd soy JUSWIOOJ JUOSINPoI NO yUDUOWISNe s]I,s ‘oyduroxa 
Jed ‘xud 9] JojoIp ev soURpUd} JUO dYOIeU Np Sloped] soy 
‘nor Jomuoid uq “xtid sap saorpul sap UoTON.sUOD BI Jo XIUd 
Sop JUSUdSST]QuId | SUBP 9TOI UN yUdANOs JUONOfl Nb smayoRy 
xnop op uosieuIquiod oun.p uoeTo[dxs,] suopudjus 


UONEWLWWOSUOD ej e XIud Sap SedIpU! S98] JNOod eHepuos ap sue|d : UeWHa/, 39 JEAeE7 ‘JUST ‘UEWLOG 


snou ‘anbruuryiig ayooidde | e suongime snou onb ‘« 9yn1q 
JO1OJ » Op osRyULAR Jeg ‘onbruuL}jlig 19 oUTeOTIOUUe SOpoIoU 
sop sofqiey sjutod say 39 syoy syutod soy jUR}O OWIWOD 
Jolgpisuod yreunod uo onb 90 owmsol ¢ nealqr) 97] 
‘somnatigyur sodejo xne Ieyap 
op Uy surow nod un neaalU UN kB SOUIT}SO JUOS TUP-oUNeAOY 
ne uonesoise.| mod soasijyn spiod soy 39 yWoIIIp sosey 
-UDUIZTA syedoISe SOP UONLULIOJ op SopoyJoW sa] ‘onpudsA 
anQuenb ev] no sasuadap sop yuRJUOU dT UOTSS soURLOdUIT Pp 
snjd oy Moae oumsos uo onb otosaye0 ey] no spe] 
JURSSISIOYD Ud JNdV[9s oseUUOT|HURYDE,] 3Sso onbruuryq 
apoyjoul eT op ayjeo yo “unjdd yuoutonbidA ‘aystIqeqoid 
UOTLUINSS | Jo ISeUUOT[MULYS | JSO OUTLOLIDWIY SPOYJOU! P| 


8e~ 


angoyejeo ne GqX-100-ZI oN ‘epeueD snbrsneisg 


op ojueutwopsid onbysusjovseo ey] ‘SosISpISUOD SUOAR snou 
onb tp -aumneAoy ne 30 stup)-syeyq xne soonbridde sapoyjou 
sop oueuuuos uostereduios oun suuOp yp neo[qey oT 


uosivivduoy S'¢ 
‘SA Pe] op queusaold ‘aja Cg 
JURSTTNN Ud oITeJ Jsd (I syHeasoida1 sofonse soy Is) one) 
-uowig]ddns uonesoide our) “(Tup-oumneAOY 9] 19 STU-sIRIq 
so] Inod oulgu ey 389 dasI[QN UoNPUOJUI,| aonb oy0s ud 
yey Sopouigd soo ap uonesiyn.[) SAA e[ op weuoroid 07 
19 PYV.] op yueuoaoid “7 ims gpuoyzysa Mu yo ‘YDSO no 


be wil 
Mee “lly aK aK Sit ad 
: soiXadseq od} ap snoyeurnss 
uUN.p opie] & gynoyeo ssoye so (7 SUOISOI soy 10 ¥ UIsed 
-eul ap sadAy say] ms sasoise) UOT[MULYSE | SUeP 2 s~HeIUIS 
-91da1 sajonze soy mnod shed np ayjoyoo., e soIpul uA 
‘gsje.yusd UoU eB UOTISoOddo sed ssiyenuad.xtid sop 
DAIIOI & SOTAH|NW suIseSeur sop syHe[oI sptod say JWosstuMoy 
nb {yy ,] soide p sosummjso ‘uiseseur op odAj sed sasuadap 
Sd] DAB D9SITN JSO SQUUONUSWISNS dNUIO} ev] ap so9puod 
UOISIDA UN ‘SoTdn[NU suUIseSeUI sop sed of sued 


ye! 931 yy 


194 fj 
OS Ghee 
: Les oy 


yal O31 y wie vel 
ORG 

Jed ‘sjuepuodapul sutseseur soy nod ‘asuuop 
dso1opuod uoU UONPUITso oUN.pP JUOWIOTeJUSUepUO} j1dv_S 
Il Juesoidor afore | 39 UIseseu op od} 9] ‘UOTSaI eT Jed 
SUIFSP S9SIOIO UONLOTISSe]O Op aynyjao onbeys suep (JY) 
souudAOU Sop ORI ap syNUJOJ ouN.p udAow ne sgnoyeo 
19 JUO samLUSUTI[S syeBoIse soy ‘TU-oWNeAOY 9] INOg 


lUQ-suMNvAOY ne uoneWysy p'¢ 


‘(9) Ud SUILUOD UTS 
-eSeUl 9] SUBP 9]OTUe UN.P 39 (q) Ud SWUIOD ussva 
Jed sJU9A op Julod uN,p UONDII9s eT Op UOSTeUIG 
<WO0d eR] JousIsop Inod bunuxow sseuuo]yURYyoS 
UOISSOIdXd | JOSITWN,p spoumwuos 4so |] : VJON 


‘SNPUDSA SUdIG Sop dA} 
-RJO1 SINUUOS LI Op UTeLID) op ajsTWOUODS | Jed 
uolenyeAd,| Mod yyysqns un jURO suUTUUOD sIOp 
-ISUOD 9.99 Jnod jo “(ney snd aILID9p oUTeOLIOUe 
ssvUuUO][HULYOS Pp spoyjoU ei suep gsTyn sed 
}SO,U ‘nesanou ap ‘Jd) sported orotuoId PT e UIeLIOY 
op dsTUOUOSS UN jeJopessod udu aonb uOHeULIO} 
-ul,p snd yromber snssaooid 90 ‘uoWeTjoINjeN 


{Db} xe 


sone 7 QOURA SR]: SUOUUO]JHURYDAa ~=SNMON “¢ 


LeC 


‘saguue xnop ins (5 ‘byw, = [ opeuuru 

gyuenb ev] suCANO snou ‘s}1LNeA onbeyo Mog ‘7 
‘TP SOISLPA 

SQ] SOJN0} Ap AIST] RB] SUOSSoIp snou ‘(9 ‘/) aguUOp 

Jneyosoider oponse-uiseseur omed oun mog ‘| 


: QyUeAINS 
uosey kB] Op vO SUOSITPULIOJ sNON ‘yUoWONbyeUI 
-9)SAs snd ey] sgjoyoR SOLA eI Op osnf ne oseuUOT[H 
-UvYOd UN SIIP-B-}S9,9 “SOJUDA Sd] JURUTUOP SUTLIOD 
OIOPISUOD dTJ9 NO [I,Nb 7 NOWeA LT SUUOTIOTIS UIe.LIO} 
ap astu0u0s9 | “Jatnonsed ulseseu un suep ‘9 IHR} 
-uosoidor yuousy9 onbeys mod ‘uowajouuonIpely (9 


CANV onbeyo 
od djINNSuOd jsd SJUSA Op s}ulod op asepuos 
ap oseq oun ‘yp yuatoyne ‘] e& | 3Ssd (AOAINS 
aseyoind jo jyutod suoydsia) SdOdL & ANV 
sollos9yeo op sjuowotiedde sop ojyuvin0d UOISIOA 
eR] ‘stug-syeyq xne yuouua0o1 e.nbsnf seo 9] 
yuouronbidAy wee mnb 39 ‘SdOd & ANV Sel0s9}89 
op soydninur sourpuodsali0o ud sos sap 
pUudjUd-snos vd) ‘SQUUOP soporye Pp aes ev] sup 
ANV UiDj129 UN, P JdUd\STXd,] onb yWoWIAyIAYO 
yeuuod ou UO ‘sTuP)-s}eyq soy Inod onb sipury 
‘asvuUO][ULYOS | JURAR SuISeS EU op o\sSI] eT Sup 
(ANV.[ ® queyeambs) 2 onbiyiosds jneyuasoidor 
gporte | ap souasqe | No souasaid ey Ins UOeULIOF 
-UI_ | op suoyoutiod snou ‘tup-oumnevAoY ox Mog ‘7 

‘ydd aseuuoyHueyos .p 
spoyjour vl op ywyoid ne ono sessed jso sieul 
‘stu()-S}eyq Sop UOT[HULYDE,] SUep s[qrUOdsIp js9o 
UO eULIOFUT aNeg ‘(UOT snd aLID9p UONeUIT}SA | 
suep 9]01 un eionof 39) uoneoyHens ey Imod 
s9styN so uIseseu op odAj oJ INS UONeUIOJUT,T “| 


- STU) “SIE 
xne sonbijdde spoyjour ey e yoddes red yusams mb 
SIOUDIIQJIP Sd] SUOUSTTNOS “jnNo} Ud OP WOS UOIddI 
Jed jneyuosoidoi ojonse-urseseu somed QQ] 9o}STXO 
[I ‘stug-sjeyq soy Inod uonyinuns ey suep « aJUdA 
ap sjutod » ‘ap QIQUIOU ds] DdAR ApPIOUIOD (UOISOI 
onbeyos op jyeyuosoidor oponse sed g) rup-outneAoy 
3] Inod uoNrinuNs ev] suep suIsedeUT op sIquIOU 
IJ ‘Jueussoidel gponsey mod soantsod jusrej9 
sasuodap soy sfonbsay mod sutseseur sap ostwiol 
sues (spa) o[dumts onoyegye aseuUOT[HURYSE,| & apo 
-old suoAe snou “Jorfijduis mod ‘seo onbeyo sueq 


(g ouTeyd) syuepuodaput suiseseul soy mused = ¢ 
(p ouleyd) asiyeyus. xtd 


Op 9AdTO1 & o[dNH[NW UIseseU UN.p yURUDAOId | 


900Z aiqwiss~ap ‘ajenbusa,p senbiuyoe | 


(ZL ‘9 ‘¢ ‘¢ ‘Z ‘[ SouTeYd) dsT]e.QUDD UOU 
xd op 9Ado1 & Soydyynur suiseseul soy ured yp 
: JMS [I SUTWOD suIseseUL yINY QUUOT} 
-O9J9S SUOAR SnoU ‘9 JeJUSSoIdo1 oTOHIe onbeyo 
39 7 Uolsa1 onbeys mod : a3URAINS UOSdSey eI Op 
gpeco0i1d suoae snou ‘apnys ayuasaid vy sueq ‘aydn 
-[NW np oijied jURsIey SUISeSeU So] SNO} sURp 9[91 
-Ie | op xd np Jnejuassidos OWIUIOD SIBpPISUOD js9 
30 UIseSeU 90 Op [BUDD NeoIng np soidne dAdIOI 
yso gponse un.p xd oy ‘ojdnjnw ulseseu puvis 
Sol} UN,p sed do] SURp : « OSITeIUDD \sa xd sop 
QADOI 9] JOP »» sopose.p suoT[WUeYdE .p sed yudIy 
OU UlelI9} Op saystMIOU0DS say] ‘oJUSsoIdoI Je} 
-uosoidor ponte. onb susiq op odA} ne ulseseul 9] 
suUep 9910RSUOD S1DTJJOdns v] 4S9 d]][1e}] Op oINSOU YT 
no “dd aseuuoynueyss Jed oye} 939 & UOTDOTIS P|] 
‘{USUUTUDNOI Sn{g ‘sotidoidde sutsesew sop odepuos 
op oseq UN }IMNSUOD HR UIeLI9} Op d}STWIOUOD || 
onb soide ‘ussva red reste} os v[99 “yUdUTOTTOUUOTIIP 
-elL, ‘T]Qe19 99 Wop JNeuosoidos oonsJe uN.p xud 
3] aJonbe] suep ssotpnonsed oy]e0] ouN suUep SUIS 
-VSCUI Sd] JUDSSISIOYS UIeLID} Op SoSTUOUODS soy] (q 
(‘SopoTUe Pp SayVIys So] SUBP ANV Sop OSIWIdI ddA 
aseuUO][HUeYdS | op osneo ve ‘odTNUIS SUTeOTIOUIL 
Spoyj}oU ev] SULP NOI] WOAe ynad a9}9d91 UOTIDOT9S 
RI) ‘syueyosoidor soponse sop s9j9d91 UOTjD9T9S Pv] 
sed jouriod ou “rornonsed us “4a amo0je9ye sed 4s0.U 
UOTJOITAS B] (II {7 SUOIS9I Sop d[qUIDSUD | INS SUTIOJ 
-TUN }Sd UOT}OOTIS vL] (I : OUTVOTIOWIY SpoOy}oU ve] Op 
ayuepuodsasioo (e) odvj9 | & oddel ied soouarayyIp 
xnop JoUusT[NOS op JUsTAUOD I] °“y7 op sopueIs snid 
SO] SINITBA So] JURA sjneyuososdas soporjie xnop soy 
SUOUUOT}OITIS SNnou ‘WOT}Des onbeyd suep ‘(UOTeTNU 
-IS eB] oouliod mod yuowenbiun) opnjyo ojuasoid 
RT sueq “YY UOTdaS onbeyd sup 9UUOTDEI9s }sd 9 
sjiyejuasoidos sajorie .p « osnf ne uoypnueyss » ug (e 


: SOJUVAINS sadv}d soy] PUdIAUOD SdAdTOI 9.9 
yusAtop xd soy sjonbsay nod sajonie sap uoNde[9s eT 


dJUVA OP syutod sop ssvuuolUueYyIy ESE 


‘stuy]-s}e1q Sop Od].] 9p Uoe|NuMIs ev] nod SdOd 
SUOT}LUSA Sd] ormsu09 Inod sagsiqyN sayjao onb saguuop 
SouIQUI Sa] ‘sadessed QOS Sap UNdeYD Inod ‘_yY suoneUINsS 
Sd] OIIN.SUOD IMod ‘suosI[yN snoN ‘stU-SIeyq SOP SdOd I 
Jed sogsiA Gneuasoidal aponie) ANV Jed (uiseSeut) QJUSA Op 
yutod suoneurnss p uoyUd}qo | onb ye1suas snyd yuous[qviop 
-ISUOD jsd JIdDAafqo jog ‘Useseur op odd} Jo UOTOAS Ied 
‘M7 sosuadgp Sop SUOTRUIYSS Sop I1U9}90 ,P 189 FH9/GO/T 


(suiseseu-3jgnbuo) Aambuy suyiejoy fenuuy 7'¢°¢ 


ansojejeo ne G¢qX-100-ZI .N ‘epeueg onbysneris 


sty) -S}ey 
so] JuastA onb °/7 sogy]reiap snjd suoryeurnse soy 111990 
B sed oyosoyo ou Tup-ounvAOY 9] onb suojON ‘SqJ SoouUOp 
op safquiasus QOS ‘NesAnou op ‘suoAe snou onb o}J10s 
op ‘Tup-oumneAoy np Sqyq eT mod yo stup-sieyq sop KAO 
R] Inod saguUOpP soy aU sUTYORUI-oSessed red ouTyORU 
-odessed s0uvploou0d oun 9ysTxo jI.nb suosoddns snou 
‘apnys ajuosaid ve] op SUZ xNW “UOT}99S-UOIS9I SUOSTLUTQUIOD 
sop mnod *’7 sasuodsp so] 39 ‘2 syneyuosoidar saponse 
sop mod ° 7 sasuodap say Joumse,p jso Joolgo,] 


(saseugui-aygnbua) Sqq T'e"€ 


*xLId sap JUOUOSST[GeI9 , | 
Inod sajpoze sap JouUoNdeTas mod ‘suiseseul sop o]UdA 
ap sjulod sop soidne oyonbue oun (¢ 30 uIseseu ap odd} 
yo uoTdes Jed sasuadap soy Ins syUsWIdUsTEsUdI Sap 11U9}G0 
Inod ‘(Ky) Aumbuy surprejoy jenuuy sojodde ‘surseseur 
-sjonbua oun(Z ‘soporie.p sodnois sIoAIp op yeyor,] 
B SOIDBSUOD SJURJUOU soy JoUUSS nod ‘(¢q) AdAINS oINjIp 
-uodxq Ajtuey sojodde ‘soseuow-sjonbus oun ({ : oyuUKs 
-Odwi0d SION op UOSIeUIqUIOS eT a}J0dUIOD UOT}eUIT}SA ,p 
Spoyrsu eB] “STUP)-s}eq xXNe SUTUOS ‘TUp-ouneAoy ny 


U)-9uMvAOY Np ssvuuOTHUvyd9,.p sopoyy ¢C'°¢ 


“AdN Sep syquissus | Ins 
‘y aouuop sopore.p oayens oun mod sorpul.| muajgo mod 


a[duioxa sed ‘saAadse’'] op o[nuw0y 
eR] & JUoWIOUIOJUDD KAD eB sade.p soguIss sosuodap 
SO] JULSI[IN Ud S9BdIFe JOS SOIILJUDUI9[9 SOOIPUT Soy ‘sINg 
(S007) spoyay fo YooqpUurH] STF 2] HOA ‘oseq 
ap sported ey] & sajone ud sajoexa sasuadap soy sed yUd\O]{OI 
ou oseUuUOTTHULYDE Pp sayIqeqoid say onb sored “(€QOT AeA) 
QMOID 9] & Joyiod yuoreunod uoT[HuULYdI,p steIq ap soUasqe .P 
SUOTIVIOPISUOD Sap SUULUIOD ‘47 SUP SQUUOT[HURYDE sopoIe /p 
ly 9iquiou Np dSIOAUT.] e xnes9 yuoWDduTIs sed yUOS 
au sptod sa] ‘9}0A91Iq ap tonos sed oporied op simoriedns 
SOOIPUI So] SUOWOUO snou ‘afonIe ,/ Ne siorNonsed sed 
yuos ou spiod soy aonb suojon ‘sa (f 2) 10 43931 ‘73S 


2 
ite eee 
4a 


v ~ 


104) M 


JIAB 


UONEWWOSUOD eB] e XIId Sep SEdlpuU! Sa] JNOd aHepuos ap suejd : uUeWHAa/A Je JEAeET ‘JUST ‘UeWLOG 9ZZ 


ansojejeo ne GqX-[00-ZI oN ‘epeueD onbysiyeisg 


sa(f1) 
231 ‘y30 jal 


royl] % 
‘ ‘Mg sy Pig 
10yf} i 
mM 
no 
sa(f ‘2) 
4 Y>I>1 
royl} sal 
ca 


‘ oo i 
yi U RE 


uyfig\. [+4 


SULIO} By USUI 
NedATU 90 B SUOTEUIT}SS soy onb aylos ap “(y oxoUUe | IIOA) 
anbiyauoas auuatoul &] Ip S|NUIOJ eT 9dope yuo stup-s}e1q 
Soy ‘sopoie.p sayens sop yednyd ej mod ‘soguue SOIQTULJOp 
83) ‘SdOd ®] ep onb sure yqD eI ap jueusAoid sasuadap 
sop suoneUINsa so] Is yuowOoOduT no yuoursOT[dxo 
SQPUO] UOSUIOY[-ZAIOH Pp SIMIyCUIIYsd sop JUOWUdT[ONUASSO 
JUOS SOIIeYUSUIDTD SooIpUl so] ‘SlUp-s}eyq xXNY ‘“SAoI2 
snd xnevoAlu sop & SOdIPUI Sod JodOIse mod onb soestun 
yuOS ou sosuddap soy IMs saguUOpP soy 19 “WIO] snid yLOSp 
Tup-oumnvAOY Np PLY INgeuUINsa,] SUMUTOD ‘aR ,| NO o0S 
sun .p sagiapuod uou souusAoUul sap JOS o]qley snyd oy NeoATU 
ap SeoIpul soy ‘opuow oT sUBp ynoyIed Dg] sop yednyid zy 
sued ‘DdI.] JNWSUOD 4s9 sjonbsop Imied e s}UDUIgTI Say JOS 
‘sopoe pp aes x qd .] op Nes ne ddIpUT.p suoneUINSS 
sap olIp-R-4s9,9 “7 « SouleJuoUg[9 syedoIse» soy 


squy)-Sye1q XNv UOHeUIS| 7"¢ 


‘onbrun SqdOd/XaO Uonestess oun e Juepuod 
-SalI0d UNdeYO ‘souTyORUT sasessed QQS 9]Nd9XOd SUOAR snoU 
NROANOU Aacj ‘QUUOT|DETOS UISeSeU Np JUOUID}DOIp yURUDAOId 
no soseusu-sojonbus xnop sop syne] No 9uN,] 9p JUCUDA 
-old sasuadap sop suOTIeUISd Sop UOTJOUO} Ud ‘OSTUUDI OAR 
jdd yUOS 3yUdA op sjulod sap asevuuOTNURYIE | ap syoodse 
sa} sno} anb suojou snou ‘ouog *z ‘t=4 “ld xd soy 
SUO.NSISOIUS snou “sUUOTOEI9S IsUTe ofOIIe onbeyo mod 


‘ydd s3euuol[Hueyss Jed aporsre 
un suouUONd9T9s snou ‘a}U9A op JuTOd 9] suBp asep 
-UOS 9p aseq 91199 op Udo ne ‘jo ee) sported 
sigtwaid ey] eB sayuepuodsolios sasuadap sop 3a 
ANV,| & Jueusyiedde sajornie soy sno} op « oqsI] Py] 
SUOSSOIP » JO BJUDSA op juTOd a] suep (qUdWETeIN}II] 
Ye UlelIO} op juose., WIWIOD) « sUOTTe» snou 
‘(0 “f) ANVW-0qU9A op yurod odnois onbeyo sueq (9 

‘TonjUudAd UOTOd91 Op oIdap 
UIR}IDD UN DdAB ‘OP Op [e}O} OIQUIOU UN jd “qgn 
Jed 9jU9A op yulod-qNyV sosred QQ] Ssuoud}go snou 
‘no, ua ‘ouog °/7 SdOd BI s2ide,p sasuadap sap 
SUOTICUIT}S SO] oye) op oIMsoW SUTUOD JURSTTIIN 
us ‘upjdd aseuuoynueyse red / 93UdA op syutod 
}INy suo. snou ‘suUOTOAT9S 9 ANY onbeyo mmog (q 


GC 


"XAO P[ op o9alop 27 artes 
op oinsoul ey ooae “(4njdd) dSTWIdI DdAR OIIIe} P| 
® ojjouuonJodoid ayyIqeqoid dove oseUUOT[HULYIE 
ied 9 YNV Xnop suouUOTDII9S snou ‘Y safoIVIe -p 
saves XIp sop ounoerys yo “7 Aq onbeys Imog (ve 


: SQwUAINS 
sodei9 sa] pusiduiod soadjel a9 JUSAIOp xtid say sjonbsoy 
mod saponie sap uonosjas eT ‘¢ sguue onbeyd mog 


9}U9A op SzuIOd sap ssveuUOT[QURYyIYA «ELE 


"XAOD PI op uonesiyeos oun e otredde 
919 uNoevYyd yuo Inb ‘suOTPUISd Pp SoTqUIdSUd QOS NUDa}qGo jo 
souTyoeUl sadessed (IS 9INdAXd SUOAR SNON ‘272 ‘1661-9661 
Mod 966] SIU “9661 -S661 Mod C66] “SOIPUT.| Op seq ap 
aouuR SUIUOD 4 sUOSSISIOYD snou “KqD PI op soqjoo onb mof 
e snjd ane e souRpUd} JUO SdOd PB] Sp soguUOp say onbsing 


(1d)svU231 Id yy 
by] 


ic cG TN «d 


: WOISUD}XO .p 
moyory e Inoyeumjsay op uodAow ne uoNneUNse] 
® opsooid yo upspa sed "“u are, op (7d)s suojjnueyos 
Sop 911] SUOAR SNON ‘onbruuryig ayenbua., ap uonon.nsuos 
ve] aod sonbynuspl soguuop sop 9sI[yn suoAe snou 
onb sored ‘apnyd,] op SUOISN[OUOD soy INS soUSpIOUI.p sed 
eINE .U UONOYIPOU 9y390 ‘NvaAnoU 9qJ ‘d][901 SdOdL ¥I OP 
ayJ99 Tf /] UOMAUS,p UorsIogid oun MOAR WeIASP « SdOd 
op UOT}E}IWUT »» aOU onb dzIOS op ‘aNIOW op UOT]HURYD9.p 
Soy]ie} Soy yINpet suoAe snou ‘uonbgsuos seg ‘a[qeyreyNos 
y1e9,U [I.nb sopueis snjd qq~Q soy suep sseuuo][HueYs9 .p 
suolRy sop guUOp Heme snouU sjUdWONSISIIUS (YOO OZ 
op Joyo aHOU suep UOTTHULYOS Pp soT[Ie} Soy spUodsa0S 
oirey aonb dIQAv 4Sd,S I SICU ‘dT]901 SdOdL BI OP SoT[a0 DAR 
ainpsooid ajou ap sonbysyejs soyatidoid so] Japs1OOUOS sITRY 
OP ‘XAO PI Op sed do] SUP HR] SUOAR | SNOU SUTLUOD ‘Ss90I0JJO 
soumuos +snou snoN ‘suevonenb soy sno} uoTHUeYo9 | 
Op JUSWII{[IANOUd 9Av UPd UN UTES ‘auOYd9s]9} Jed s9sI[eoI 
‘onbiput | WOU UOS SUILOD ‘4js9d sTUP)-S}e1q SOP d]J9E1 (AdAINS 
asvyomd JO jwlog ouoydajal) SdOdL BI “ANW.P 13e,s 
[I.nb suosoddns snou ‘tot ‘GNV.p sednois sop no qNV sop 
a9 JUdIeLMOd salI0sgeVd Sad “sUdIG Op soraTfNoIed solos 
-9789 Sop Inod 9]U9A op syutod syusrayJIp suep sosuodep sop 
UONGLsIp el JOUINSO,p jso ajonbua 9999 op Jnool[qo.T 


(sosevugui-ajonbus) SdOd TIE 


‘sosuadap sap suoneul 
-1]S9,p JURpUOdsa.IOD ayTquasud UN yURSINpold UNSRYS “KAD 
SUOTTHURYOS (OS 949 sUOAR snou ‘noy Ug ‘9a “A'IZ = CT 
Jed 9uIWsd jsd 9 QUUOp ANV UN suep “qq Sep s]quuas 
-ud | & Npudjd ‘Je}0} 9] ‘ajduioxe Jeg ‘UoKeUUUOS oydutIIS 
Jed sooumtjsa 939 JO nedAru yney snjd op sosuadap so] 


900Z eiqwazvap ‘ajenbua.p senbiuyoe | 


7 00E~ d}UDA Op JUIOg 
L¥S ER] soureyD 

p surey) 

y 8 surey) 
osvuuo]nueyse .p 

] € omeunud xcbis 
ajoquiAs aiqN ou 


ansoyeieo ne Gd@X-100-ZI oN ‘epeueg onbysyeis 


UIseseyy 
[e1yu290 sin 
> adnynyy 
[e.U99 9AdTOY 
juepusdapuy —: ulseseu op odA 
uoIsay 
ne 


d}UDA Op sjutod : « saye9190 Sap SIOATUN » | <p UOTe[Ndod ap oimonnys 
¢ neoqe 


“SOISO[OPOY}OUI Sop ag}TeyNOs 
uosteseduios ey] Inod zyYns soyITdurls UOISIOA eT “(UIO]T snyd 
JIOA) TUp-owneAOY Np sayuepuodsao0d sapoyj}SW soy] suep 
Sd9ST[N 939 Issne JUO SdI][IONdeI « SdxsevUdU Sap saguUOp » 
soy onbsind ‘stojaynoy, ‘sogst{yn yUOS saya soyjenbsay smod 
9]U9A op sjulod sap soidne sajonbusa xne saguue smotsnyd 
Op SOIMdLIDQUB JUSANOS JUOS XYD LI Op Sayjoos soguUOp soy 
: qJUd001 don 11819 ITO (9661-S66] Mod) 30 ‘sasuadap so] 
IMS a][991 sJonbus 93no0} suep s[qQe}IASUI aIMsSoU Op INDIO] 
ap ajduuoo sed jz1eud} ou aya ‘suonsodoid sourgur soy suep 
soporte soy yua}oyoe QUUOp 9]U9A op jyuIod uN.p syUaT]O soy 
sno} aonb 9319e} asayjodAy ,J ins yresoda1 stso;Opoy}eu 9NON 
‘oTJoo1 ajonbus,| ap sorjljduits uOIsIoA UN 4Sd « XD 2 
Op UOT » 94399 “xd say ns aJgnbua J no (UIOT snyd OA 
‘« d > 48d aJUepUOdsa.I0D UONKIOU eI JOP) SdOd senbus J 
XO Honbus ] anus uonounsip ey omey e yUoWduITIs 
yios “u suep yo (/x)s Suep x 9] fo]JoOI OUTROLIOWIe XD PI 
op Sed do] SUBP sNUd}go xndd op jueYdoIdde .s suOTeUIT]SO sap 
UONLLICA IP SJUITOIJOOS sop ITU9}qQO Pp 39 SUTROLIOWIe XD P| 
OP UOT[HULYDI ,P Sd][OOI Sd]]Ie} Sd] D9AV JOPIOOUOD kv UOSe] op 
soIsioys “7 Adf.1 Suep (7X) KAD vor HueYS9,| op o][1e} | 
9 “Uu 19 (9661 -S66| US j adn J od syuoWONsISeIU .p 


aiquiou) uonefndod op oye; ey iso JN Sd Wb = “lq no 


— OX)suaa! (MX)SURL Pay 
Faire. ids i Riarges Cri Ge 
i) 

STeIq SUBS UOISUD}xa Pp 
IMdOLJ B SUOTNLUISO sop ITUd}gO ke oJOTUeU Op “qd Sy 
suep qney snd yLo9p Jaryory np Imsed e (uwpsva) asTUIdI DOAe 
gjdunis omoyegye osvuUOT[HUeYOS UN ev 9pgd0id sUOAR SNON 
7 ddN.J Suep 2 ANV.] op cnn ne soseusu sop soyniq 
sosuadap sa] omp-e-yso,0 ‘”7 JoUINSd,p so JHOalQo.T 


(sosvugui-sjgnbus) xXqO Te 


“ANV 
/yudA op yuIod suosieuIquIod say suep stiduroo sajonie .p 
g[quissud un jso ajonbusd swWdIsION ev] op UOT[WURYDO,T 
‘SdOd ®1 1° XAD BP] Saude p soournsa sasuodap sop uonouoy 
JUOS o]]Ie} Op somsour soy no ‘(¢dd) ayIe} eB] e& d]JoUUONIOd 
-o1d ayijiqeqoid d0Ae SUUOTDEI9S UOTTHULYDE UN IMs ‘oJOTUIEp 


R] 30 Sojdumts samoyesye suo]]WURYDS sap INS sdapuoy jUOS 
sajonbus sosomuoid xnap seq ‘(anbiyduros snjd yuoweyou 
ylos onbyeid us sfojdure oseuuoyHueyss | onbionb) asiwo1 
DAB dOJVITe 3SO UONLINUIS ve] Mod oseuuo]HuLYOE | ‘seo 
SION SOT SUBC] “SADTOI 4SO xTId 9] JOP S[ONPIATpUI sopone sop 
SQUUIOT}DOTIS JUOS ayjonbe] ev sows ‘aJUDA ap sjuIod sop soidne 
sjonbus oun (¢ 39 ‘ajUdA op syulod sidAIp suep sasuedap 
SJHLIOI syURJUOUT so] ‘soponse.p odnoss onbeyo suep “rouse 
mod (SqdQd) AeAINS aseyoing Jo yulog seajedde ‘soseucw 
-gonbus suerxnop oun (7 ‘sudIg ap SdlI0T9}¥9 SOSIOAIP oud 
saseusu sop sasuadap sop uonnredal vy Jowmnse mod “(xqD) 
AdamIng omppusdxy Joumsuoy sejedde ‘soseuaw-ajonbus 
oun ({ MoAes ev ‘aystiqeqoid oseuuoTMUeYdS daAe sojonbus 
SION JUa}ISsad9U Inb ‘sTup-syeyq xne soonbrydde oseuuoyy 
-UBYO9 ,P SOPOUJOW so] sILID9p Ted suOOOULUIOD snON 


squ/)-S}eIq XNv aseuUOTHULYII,P SOpoHIIA, T"€ 


‘(SQ0Z) /BnU_YY [palUYyra I, SAXAPUT AIL AQUNSUO) 
3] suep saynsuod ono ynod mp-owneAoy ne sogdope 
saqusoe1 snjd sonbyeid sop uondiosap sug (8661) JonUDYy 
jonuyra XAPU] SAMA SpoJay ay], 9NyWUI JUOUUNDOp 9 IMs 
SQpUOJ SOLULOS snouU snoU ‘TUP-sUNeAOY Np [Iejop op xd 
Sop SoIpul,| Nog *L] eMIdeyo “(¢0OTZ) spoysayy fo yooqpuvyH] 
SH 21 SUeDy SMA Bere Sep. Dd SP. UOHSANSUOS, 2]. Sp 
UOTdOsap 9UN BIDANO ISSoIDIUT BIIO onb M999] YT] “sopoul 
soo yuaymsod aonb sayrxeyduioo op owuwes ev op ajduioo 
yueUd} Ud ‘AseUUOTTHURYDE,p S}OUTSIP Sopouw xnop Joredur0s 
® jomnjd suoMpoayO sNON “SOJULICA So] SoyNo} JOgoO{sUd.p 
Tu ‘opoyjou amoypiou ey osipyn shed janb JouNWwuaj9p op 
sed 31e}9 U JHDALGO ANON ‘sdursy a] suep JolNonJed yurod un ev 
SOJULLIVA Sop OUTOUU JUdJUASEId yo sduua} Np s.mood ne yUaNOAY 
sonbyeid sag ‘sked xnop soo op saanoodsor sonbneid 
So] Soide Pp So9sSITaPOU yUOS TUP-sUNeAOY Ne 39 SIUP-S}eIq 
xne sogjdope soyooidde say Jopnumts mod sogsiqyn SUOAR 
snou onb ssenbyduios aseuuoyyueysd .p sopoyjou so] 


Sog[NUIs BSvUUOT[HVULYII,p SEpouWA “¢ 


‘Tu -ouneAoY ne jo sTup-s}eyq xne 
suoneiedo sop soseyd say soyno} JoTNuuIs nod (93s ey] sup 


UOIJBWIWOSUOD ke] & XIId Sap S8dIpU! Sa] JNOd aBepuos ap suejd : UeEWHa/) 8 JEAeA7 ‘JUST ‘UeLWUOG V2Z 


angoyejeo ne Gq@X-T00-ZI WN ‘epeueg onbrsneis 


« JOIyoy a] »» Juowayduns gjodde) uoneyfndod ap soryory 99 
QSI]IJN SUOAR SNON ‘Uosonb ud saguue xnap (Sop JOLIAg] Ud) 
SNPUSA sopor}Ie sop (ssouo Ud) sgyWUeNb Jo xUd say‘), PD J0 
‘ed ‘Db ‘dye *-Q odnoss puess o]/sosuadgp op o11089}89 
RL ‘Y uoKoas/saporie p aes el ‘9 Jnewosoidor oponse 
JANV.[ ‘2 9}9uUeA espe, ‘f ulseseu/qjucA op jurod 
3] ‘¥ ulseseul op odd} uos/outeyo es ‘7 UOISd1/qq UOS 
d]U9A op yulodeponse onbeyo ke sate yWOS “f 9yUDA op yuIOd 
un suep 7 opie un.p yeyoe,| JURJUOSoIdoI JUSTO SIsOIUS 
onbeyo ‘9661-S66I ep SedIpul soy mod syusweNsidoIus 
000 07* «AN 9p s9myHsUOD ysa UoKENdod ey ‘ouog 
‘Tu;)-ouneAoy ne ssonbrdde sapoujour sap uondiosap 
®] SUep UIO] snyd saguUOp yOs souTeYyo op sodA} sto.) sod nod 
UONCUITSA P 39 9J09]]09 Op SapoyJoU sa] “asiye.QUdO sed js9_U 
xLId sop dAdoJ 9] JUOP SUTeYD SUN SUC ddIOPISUOD 939 
B oJUR}SoI oUTeYO onbeyD ‘JWoWaTenUS. ssToONUOD yUOS xlUd 
Sd] JOP 93U9A op syutod op sadnoss soj mod tup-sumneAoy 
ne ososijgn uorssoidxo ‘“(ajdnjnur § payooyjoo = ATe.uao) 
« gsIjequsd yso xlid sap sAdfoI a, jonboy mod odninu 
UISESEU »» UN SUIUOD ddJOPISUOD 949 B ‘OJUDA ap sjtiiod sap 
a] quiasua | Ins xd sap aylouasowoy spuess snd vy JoyUasoId 
gjquies nb ‘p outeyo eT ‘(tup-suMeAOY ne juepuadspul 
omejotidoid un e yueucjedde suiseseur soy Jousisop mod 
QSI]N SUI9} 9]) « sJURpUddapu sUISeSeUT » op sTquUdsUS UN 
OUIUOD SdISPISUOD 939 B Q OUTeYO eT ‘TUP-owINeAOY Ne oseU 
uo] HueYoS | mod sgst{WN aUdA ap syutod sap UONLIISsEIO 
PR] & « SOUTRYD Soy INS daseq sINjONTs »» 99390 op juowoLedde | 
op sloqT ‘(« souTeYyo-IUTI »» soureyiso mMoAe A _ jeunod 
[}) oureyo opueis oun e sod yueuoyedde,u qudA ap syutod 
sap asoduios « jno}-aLmMoj » adnoss un jso mb *« g outeyo » 
eR] op uondsoxa |; e ‘untOD amejoLIdoid Un yO s9uUOp 
surveys oun ev juvUoyIedde aJU9A op syulod say] (‘« sajdyjnu 
suispspu yy sagjedde yuos souleyd soy ‘tup-oumneAoy 
NP dIBOJOUTULID} KT SULC]) “SOT]]IONDII 949 JUO SOTeII9O Sd] Ns 
saguuop soy soyjonbsap mmsed e stup-syeiq sop onbrydesso93 
aseuuo][Hueyos .p someuud soyrun sion) saq_ yuadnoser mb 
‘(tadory ‘Aemayes ‘o[duuoxa sed) soureys sop e yuouuanredde 
QqUdA op sjulod say “¢ neafqe} ne soWINSaI jso oINjONIs 
o99 ‘spore UN NpuUdA 939 & NO HOIpUD,| ap onbystigoeIeO 
« gyeneds » amjonys oun spessod suonovsuey op uonendod 
anbeyo ‘sopoie soy Ins sopuoy amjonys ev] op snjd uq 


! Ce spPnIv Spel 
5 6Z (ANV) 99U9 .p jJuequasoidal 
NedAIU ap d]ONIV spon Iv 
Y Ol SOPOT Pp 9eNS WOT}09S 
a v sasuadgp ap ati0s9}e9 odnois purln 
ajoquidg sadnois ‘A-7 A-u 
ap d1QUION 
SopoAv : « SayVaI190 Sap SIOATUN » | ap UONeINdod ap aimjonns 
¢ nes[qeL 


‘sAed xnap so] suep sogsTyyn 
ISLQ IP SOPOYIOU! SOP S}YRIOI Sa}LIOU So] dUIBNUOD INb 90 US 


€C? 


SUOISN[OUOD sou Ins sOUSpPIOUT.p sed vine.U yUOUA\sN[e 39D 
‘ayooidde onbeyo suep s9siyqn jos UONeULIOJUI.p s}QUeNb 
ourgur vy onb Jamsse mod souayeAmbs,] 19010} np ouop 
SUOAR SNON ‘JRWSOIdaI spoRIe | onb sonby1oeds saponse .p 
sovios op snd yuowsyqeqoid pusiduios ANY, ‘oreioues 
a[8e1 ua ‘ajduioxo sed ‘stup-s}eyq sop sjuepuodsano0s 
su089}e0 vy onb oyn0d snd no opue3 snjd ono yWeLmod 
Tup-ounerAoY np os]joo1 oos9}eo oun : MON) ‘2 ne} 
-uasaidal ajonie/ANV onbeyo suep 7 sojoLiea/soporse |] no 
OI 39 “(Z 8 Ud A [I NO seo UN SURp Jnes) Y UOTDES/So[OIVIV .p 
ayeys ied 9 syyejasoidol soponie/qNV € ‘O odnois puss 
un/ali0s9yeo oUN SUP Y SUOTOOS/SOPOIIe.p sayeNs ¢ NO Z 
9}STXO [I.Nb sUOJON “‘SNpUdA JOS soafoIe soy soyfonbsay suep 
sonbrydeis098 suOIsaI Sop UOTOUOJ Ud SddSTAIPgns 3100U9 
JUOS SdlJOS9}e9 sao sTeU “« SAPOIIe.P 9e.S»> vl op NoATU 
3] OUIp-e-}s9,9 UonesoIse p Ioiodns JUSWI}DeNIp NvoAIU 
nev sonuajgo so10s9}e9 soy Inod syinpoid yOs saorpul soy 
‘SIU(]-S}RIY XNY ‘SOXOUUOD NO SoITeTIUUIS sapoTR Pp d]quiasua 
un yey ua 1S0 nb ‘stup-syeyq sop ([ Jaq No way jaaaT Ayugq 
siejsue Ud) FNV no donue.p NvdAIU op Boe | eB puodsa109 
I Tup-sunerAoy xne ynpoid yso sorpul un jonbne sjqrey 
snjd oy UONRSaIse Pp NdAIU dT Sd « JHeJUOSSIdOI J[OT » J 
‘ojorie yuosoid oy] sUep 9SITYN UOTPOIJISse]O op NeoATU 
onbeyo e jyuepuodsaii0s sjoquiAs 9] 39 UONeSOISe Pp NedATU 
onbeypo e sodnois op ssquiou 9] ‘sed xnop soy suep s9siqiyn 
omjepouswiou ev] stidwios A ‘oynysuod 939 & INb UONe] 
-ndod ey ap saporie sop omjons el suUOp Z nealqe} oT] 


‘oyrepredut justia; qeu 
-UOSIBI JOS IQUSSOWOY ,[ onb d}Os op jeI 939 & JING 
un.p ynole J 39 ‘soussouloy sadnois-snos soy ospuds 
ap ing mod pear soyoojd yUdTe}9 SULIO) SUC] Op SddIpP 
-UI Sd] JUOP soponIe sap yuowodnodel aT ‘sjusoe{pe 
sojore soy odnoisor yo ‘aqimyiod sompul.| op IMoyeA 
INI] Ip UoONOUOJ US odno1s puvis onbeyo suep saporpe 
So] OL) ‘SdoIpul soo ke }INIG UN gynofe suOCAe SnON (Z 
C66] & JUSWIOATJLIedUIOD YQOZ Inod (9}U9A op 
syulod sop o[quiasua | Ins) sponte soy inod osreyun 
INI[eA OP SddIPUI soy JURSTTIN US ‘aseq op soguUOp 
So] SUBP STIdWIOD sapoTyIe 9ZE Sop UNdeYD INOd SUID} 
SUC] Op Xd op uONeLIeA eI g[MOTeo suOAe sNON (T 


: OJUVAINS UOSe] P| ap sodnois 
-snos so] juonbasuod sed suosstulyjsp snou ‘uonenutts 
Jed opnjs oyuasoid ey op suyy xny “xld sop soourpus} xne 
yey B Inb 90 Ud SoUaSOUIOY 3.9 & DOULPUD} JUO SOUIOJ ISUTL 
sodnoJs-snos say onb jsa ‘sympoid soo mod MoAe yWeLMod 
uo, onb onbasurnut jo19UT yno} ono ‘suOSIeI sop ouN,T 
‘syinpoid op sodA} ap uoNOUO; Ud sTUTJSp yUOTeJos sodnoIs 
-snos so] ‘onbneid uq ‘sasoise suloul sodnois-snos uo 
SOSIAIP 939 JO ‘STU -S}eVq xNe « SasUddap ap SdlIOBg}e9 »> Jo 
Tup-ournevAoY ne « sodnos3 spueis » sojodde yuos mb ney 
snd sysop « sjamyeu » uoNendod ap sadnois anenb say 


900Z aiqwsacd—ap ‘ajenbua.p senbiuyoe | 


‘Q[qId UOneindod 
IN] op sanouresed soy yUOUISD UP-owMvAOY 9] 39 STU 
-syeyq Soy Jonba] daAv sadoNs J] JON[eAd UOU 3d Sazsojopoyjau 
sap SOLIOUI So] Joreduiod suolnoA snou onb Jorqno sed 
yney ou T] ‘oyNe,] op no sed un,p sapoyjow xne JUSUTOUIOY 
-U09 Sd9}Nd9Xd UOTLUINSI p Jo dseUUOT[HULYS .P SdIANO.pP 
UOSTRUTQUIOD OUN }1R}9 « OUTYOLU-adessed » onbeyD “966 
Ud 19 CGH] US sooNjoayJo seq op suOoMoKSURN Soy ‘ofduIEXa 
Jed ‘oguuop uonendod ounp gedo1 oseuuoynueys? | 
® Jopgo0id ke jeISISUOD s[eJUOUIepUOJ dOpI,J ‘sfnoedsal 
SOUISTURSIO Sd] DOAR SjORJUOD sap kB 39 sjonuvU sap zB 


ansojeie9 ne Gq@X-100-ZI oN ‘epeueg onbysneis 


20vJd soxo[duo0s ajgnbua .p snssacoid say Ins da]]Iejap UOTeUL 
-JOJUI.p Josodstp op souryd ev] Nd sUOAR snou ‘sed xnap so] 
sueq ‘jUuoWsAnoodsor ‘suUOsIel x1oyo Jed oseuUOT]HULYDE | 
yo gsT[Iqeqoid osvuUOT[HUeYDS,| JUQUOSoIdo1 mb ‘tu 
-oumneAOY ne 4o SIU-s}eyq xne sosi[n sseuuoT|HULYDE .p 
suvjd soy Jourxoidde .p so10]yo SOWUWOS snoU snou ‘DJ S3] 
mqe}9 Inod onbyeid ua sonbijdde yuos sjt.nb sya ‘suuostes 
xioyo Jed yo qsiiqeqoid soseuuol[yueyos sap dsAnvyol 
opnjynoexd | JOIpMe Pp UIPY “dseq Sp sajdI}Ie so] IMs soquUOp 
xne soipuojoidde snjd suonesyseaur sou suo snou 
‘Jorjljduis mod yo ‘someunuryoid suowexa soy soide.q 


‘ogigpuod uoN + 
‘aseq op opoliod ve] e sasuodap soj red aolopuog sy, 


TLSO'T €S90'l 64880 OLE9T SOOT E€SE0'T SLI9‘O veer aseq ap sopone “sureyoug 
ZLSO'I 7r90'T SE68'O S96S*T SOOT EEEO'T O€E9‘O 696€'1 sapolye sop sjquissus “sureyoug 
IISO'l OZ90'T pSss'0 OSIT'T 91860 sPr00l  I¥98°0 I180°1 Pod soieulpslO 
0786'0 $6660 08680 697EI 87E60 0760 LSS9°0 8081°T 9seq op Sapore “sureyoug 
S9T0'T €9ZO'l 80€6'0 8ZLEI 96960 19960  6689°0 ZO7T I Saporye sop sjquissua “sureyoud 
97L6.0 S1860 7680 09660 96760 61£60 9298°0 91L6°0 pod seoyntf 
76880 78680 S8SlL°0 ZIZ9T vOLL‘0 6r8L‘°0 ~=—199€°0 16SEI 9seq op sopore “sureyoug 
0106°0 BOLO Oen 90SL Ui pOSLS Waele Ome S COLO S780 Ivee'l sa[olue sap s[qulasus “puleyoug 
ZOL8‘0 LI88‘0 LIbL’O LS%60 868L'0 €16L°0 6€L9°0 SS88°0 pend Sepiong 
ISI VLELL. 65460 <9LC1 IccL} . OSITS ~ S986°0 pOst'T aseq ap saporie ‘sureyouy 
SZIT'T SOUL Im eShG Ome Cri Gl. O1CD LV O6Cli, | PL860 1O8T‘T soporye sop sjquesua “sureyoug 
660'1 COL] WAMOUSGOWMGOS Deli M6801 LP801.  €SZ0s QLIT'T polld sepney) 
+anbiujawoas Wy  o1leyun soskodsey sJoysty  sIADWUIQ, sYyoseeg ,onbinowio0ss 
auuatopy Maye osuudhoyy 
000Z & S66I Inod souTeyousd 39 s}DOIIP SddTpUT 
[ neoqe 

6L88 0-5 -OLE9T <i PS00 1" €SE0'1 SL19‘0 veer aseq ap sapore “pureyoug 

$6680 = S96S*T = ESOT ~—s EE EO'T 0€€9°0 696€'I sa[otue sap sfqulasus “puleyouq 

pSS80 OSITI 91860 SPr00'l 1798°0 IT80°1 oN SeieulpsO 

0S68°0 697EI 87E60 07E60 LSS9°0 808T'T aseq op sopone “sureyoud 

80660 82LEl 96960 1996'0 6r89°0 ZOTT I saporye sap sjquesus “pureyoud 

ZE68'0 =: 09660 :«96ZH'0—s HT E60 9L98°0 91L60 pod sep} 

S8sL‘0 - ZIZ9T ~=—s VOLL'0~— 6 PBL‘ 199€°0 16SE'T aseq op sopone “pureyoug 

DOSE OT MOSES TU TELE OSS Z6L 6 S78E0 Ivee'l sepoiye sap sjquiesus “pureyouy 

LIvL‘0 LS760 868L°0 ~— E16L0 6€L9°0 SS88°0 pond SopIONs 

6516 Oise SOLE Vg ELL. ag NOLS $986.0 pOst ‘I aseq op sopore “pureyoug 

CVG OMY? DA. OIC a 6S Lal 7L860 1O8T‘T sopoiye sop sjquissua “suleyoug 

9L560 69ST'l I1680°l Lr80'l €SZ0'1 QLITT pod  sepney) 

orreyun §=soihodsey Joystiq ystAbUIQ, syoseeg  onbin9u093 

mae suudhoyy 

0007 & S66I Inod soureysus jo s}OOIIP SOOIpPUT 
[ neoqeL 
UONEWWOSUOD ke] & XIUd Sap S8dipu! Sa] Nod aHepuos ap suejd : uUeWHa/, Je JoAea] ‘Jue ‘UeEWYOG 2aG 


onsojeieo ne GdX-100-Z1 .N ‘epeueD onbysneisg 


‘OOT = S661 ‘sazreurpio soyegigo 
Sop s[qUuIOSUD .| Inod JOA} & IOMAg} 9p SOOIpur Soy Inod JUoWe][snuue SSsuTeyoUS Sayqto uonefndod 9p SSOIpU] °*¢ danSI H 
aaeUN INazEA—@— saadodseT—y—_ s9YSI¥—Se__ ystADuIQT —y  aydseeg —gy— anbuj9u1098 auuakopw —@— 


vax 


0007 6661 8661 L661 9661 S661 


Ost 


ere ~ OLT 


‘OOT = S661 “SegIINY saTeV9I90 
Sop s[QUIOSUD | INOd JOLIAY] & JOLIAQ} op SAoIpur soy Inod juoWoy[onUUE souTeYoUD so[qlo UONeINdod ap ssorpuy “p aanS1y 


attesTUN ANIVA—@— satkadseT yx ABYSIY—y¢— SIADUAQT, ye —  ayosevg —gg_ anbr1j9u1093 ouuakow —@— 


aguuy 
0007 6661 8661 L661 9661 S66l 


0s 


wt Se ee 
06 


r OIL 


otpuy 


o 


O€T 


Ost 


ae ne 7 - OLT 


‘OOT = S661 ‘Sopneyo soyeaig0 
Sap e[quiasud | Inod JOLIAgy & JOLIAQ] Bp SsoIpu Soy Nod yUoWOT[oONUUR soUTeYoUe safqio UOeINdod ap soorpuy *¢ aaNSIy 


aareyun Inge A —@— saidodse] —y— s9ysiy —y<— istabusgy —y— ayoseeg —ge anbiygu1093 suuadop —@— 


aquuy 


0007 6661 8661 L661 9661 S661 


os 


OL 


06 


pul 


IT 


Orr 


oO 


ort 


OsT 


~ OLT 
‘O01 = S661 ‘Aseq 9p Sad.ons 
So]B9190 So] INod JOMAgy & JOLIAQ] ap soorpur soy] Inod yuowWeTjonuue suyeyous soqio uoNe[ndod sp seorpuy °*z aanS1y 


atreyun Inge A —g@— sotkadseT —yx— 19YSIY —3<— ISIADUIQT —yw— ayoseeg —fg— enbuyjg9WI093 suuakop =n 


aguuy 
0007 6661 866T L661 9661 S66r 


| 
| 


=i Oer 


OST 


- OLT 


Lo? 900Z aiqussap ‘ajeanbus,p senbiuyoe | 


anso[ejeo ne GqX-[00-ZI N ‘epeued onbnsneisg 


001 = S661 ‘Seguns saqeDA90 Sap 


g]quussua,] Mod JOA & JOLIAQ] Op saorpul soy Inod juotuayjonuue soureyous sofqio uonendod op soorpuy *] aanSLy 


aalezun InajeA—@— saikadseyT—yye— Jays —se— stAbusg] —y—  ayosevg —gy— anbr.ygu1093 auuadop_@— 


aguuy 


0007 6661 8661 


L661 9661 S66l 


‘OTLPUN INI[VA Op SOIPUT | ddAv OyITeSO & Sold nod ke ‘soT[ou 
-uontpe.y sayyuenb say Ins soseq synejiodns uou saorpur soy 
anb s}e]Nsor ‘SIMIT]IOU Sp SIIOA ‘suUOg ISsne .p JUoUUOPp SII ‘s}y 
-ejiodns soorput sop uoneurxoldde | ev ey & Inb 99 Ud : syuRU 
-oidiMs JUOS s}e][MNSdI so] ‘oMeyUOUTS[S NVdATU Ne soddIpUl 
Sap [Noyed Ne SgAJOsoI JUOWWOT[aNyIGQey JOS xnop sno} ‘(ajUe} 
-suod oun Jed adispuod amp-e-jso.9) aa/gpuod uou anbiy 
-auoas auuakou oun yo “VY oxouUe | MOA — (PY) sudhoul 
xd sop ones ojduuis un ysa nb Yong ap sorpul,] : (samsiy 
So] Suep sed steur) neafqe} 99 sup soyyUeNb soy Ins sapuoy 
UOU SddIPUT xNOp sNjOUI SUOAR snouU ‘moyeUTeXd UN.p 
UONepULLUODAI BF] & 30 ‘apONIe., suep uo] snyd sgquasoid 
syle] op osorumy ey YW (p ‘sonbissejo syyeyiodns uou saorput 
say onb syyeyodns SOOIpUI sap oseyuRAep oyooidde ;s ‘sopneyo 
SQTVdI9O SOP Svd do] SULP Ines ‘sIeUT ‘UdUATeSd sIqIe] 3S9 
oIe}UN MIVA op SdIpPUT,’'T (¢ ‘spotted 9399 JUBINP JUOUTO}IOJ 
quoutsne xtid 3] yop soe UN od 7 opotiod ve] v JoNUTUNIp 
eB oouvpud} e ‘sasuodap sop wed vy] Issne steut ‘ayyuenb 
eR] JUOWATNSS UOU ‘saTeaI90 Sop sIdATUN,| Suep ‘onb sasuad 
B JUOUUOP sye}NsoI Sad ‘ayTqrey snyd yustuSy0u (astidims sues) 
que}a ByOosee Sp SOIPUT,| 19 DAQTS snyd d1O09UD yURId soIAOdseT 
ap sdIpUT,| ‘syyejodns saorpul soy onb aaaaja snjd dnooneaq 
yue}o ‘opotiod osonueid ey e sosuodsp soy sed sorspuod 
‘anbijawoas auuatou kj ‘syyepiodns saorpur sap 32 sane sop 
SUN SO] JUSUID}OJ JUOIEFJIP sonbissevjo synepiodns uou soorput 
SY] (Z ‘OJUDA Op juUIOd-sjoI}Ie SUOSTeUIqUIOS xne sol] soyQUeNb 
Sop 30 syuRjer xud sap « sayUdA »> xNB oNp dTTIQvLIeA op dIsap 
J] QUUOp jUL}Id QUSITNOS oNO.p aAWOU Inb yeyNsor ‘sonne 
sop sun soy nod zasse yuoIayIp syyepiodns soorput seq (] 
:yins ouUTWOD JoUINsaI as jnod mb ‘sayearg0 ap sori0s9ye9 
So] Sono} Nod sUTQUT Oo] ‘ATNUIOJ Vl Op UONOUOF Ud soorpUT 
SOP dSOJIUVUT JUDUMASSR[D UN SUOAIJOSGO snoU ‘oITeyUN IMITeA 
Op SdIpUL | op UOTISOd ke] ap UONE]]IOSO ouTe}IN0 oUN ped V 

‘soguue xnap 
So] Inod sayqruodsip oyudA op jurod-sjonsze suosteurquios 
Sd] Ins JuoWIoNbrun saseq 939 sed yUdIeAR.U sjoNUUe SdoIpU 
SQ] “S}IPOUIUUIOD op Tonos Jed ‘Is ‘aseq ap sopoIR Soy IMs 9puoy 
SUIVYDUS SOIPUI,| B ONbIUSPI WeIJOsS JOOP ds] ‘Wey Ud ‘4a 
sayooid jUOS sop Jo SOUTeYOUS oTeIUN IMI][eA op SddIpuUl 


SY ‘oyoseeg op jo sosAadsey] ap soorput sap jo ‘anbi.yawoas 
QUUAKOU ¥] SP Skd dT SUP JOSIOAIP B DOURPUd} JUO sTeUT 
‘sjyepiodns saoipul sop soyooid yuos syoomp jo soureyous 
SJEINSII SY] “SOTedI90 Op SoLIOs9}vd Soy o.NUS soUOUOId sTeUT 
‘« SoPOe Sap s[quIdsUa |» 19 « aSeq Op sapore» soy mod 
sonud}go sIMI[eA Soy] IUD s{QIe} Soy 4S jIeOO.| ‘neoANOU 
oq (‘soguuR xnap soy soAyIsod JUOos sonpudsaA sayyUeNb soy 
sjonbsa] mod ayU9A op sjulod/saporje say pussduros sasuuop 
SooUUR XNOpP d.US SOIPUI UN,p UOHIN.SUOdD YT Inod « sapore 
sap spquiosua TJ ») *« aseq op sapore » soy nod jo « soporte 
Sap d[QUIASUD | » Inod soUTeYOUS SAdIPUT ST 19 (QOOT & S661) 
QULID] SUO] OP S}OOIIP SOOIPUT soy OUUOP | Neo[qey IT 
‘assney ey & JUOUTSUUDAOU JS9 CE dp dII99 
JO ossieq BP] B JUOWIOUUDAOUT JS 4f SP dI[90 ‘osTeq ET & JUS 
-OLOJ ISO _G Op JIJIO ‘assnevy eI ve 4Sd D ap a]J9O : SaqUDIOTJIP 
Zosse juos sodnoss spuevis anenb sop xd sop soourpud} 
SYT ‘“SoTeasi9d ap soosayeo soy aqua syreo9 syuRyodutp 
JUS[OASI SAINSY Say] ‘SoIpUT jnNo} Mog ‘someUIPJO jo soon 
‘sapneyo Soyed199 Sop Sed d] SURP dSeq SP soporIe soy mod 
SQTNITVO SOOIPUT xNeK S]HLIOI s}eYNSaI Soy JWOUUOP ¢ B ¢ SONS 
SOT ‘JUSWIATeBE saTe9199 Op SdLIOS9}ed sane soy INOd S9TFLIDA 
yso oSeq op sapoIe so] JUOUONbIuN yuRsTTIN Us snud}qo xno0 
J2 (Q[QUIOSUD Pp SOIPUT) SOTO Soy SNO} JURSTTNN Ud sofnoyes 
SOOIPUT Sd] SUD SOUBTQUUASSaI VI 30 SonbHUSpI onbsoid yuOS 
Z 10 [ SOSIJ SOT *« OSeq Op » sapoe XNeV JULI] 9S Ud STRUT 
‘sjnoyed SOUIQUI Sap s}eEI[NSoI soy ouUUOpP Z SINS eT ‘dJUA 
ap sjutod say sno}, 39 sajonse,p sodA} say sno} Ins sgfnoyeo 
yue}yo ouudAoul vy] ‘soyquenb sa] sed sorgpuod suasow xd 
sop onel a] ‘9 ouTeIIUN INITeA Op soIpUT UN ‘onbIIONY} JO19}UT 
UOS Op UOsSIeI Ud ‘Ja YJ oYyoseeg op soIpul | sluduwuo9 A ‘soorpul 
burda mod sagjuasoid yUOS smMaeA soT ‘(« d[QUIOSUD Pp » 
SOIpul]) 6661" “S661 =4 (Ep souAgy) mnod T+4 
yo A soguure So] JUINP SUISPSeUT So] SURP SNPUDA sofoIIe sop 
9] quIasua | Ins gseq Sagions sa[ee1g0 say INod |, «J SO!PUT,] 
ap SIMA So] oUUOpP | aMsy ey ‘¢ & | SAMs xne sous 
-91dai yuos uonendod sap sjonuue sooIpur Sop sIMo[eA sox] 
"s}oUTSIP 
SO[OIUIV Qpg ‘jNO} Ud 4o oseq ap sapone g7E Wear A II ‘YOOT 
® S661 OP spoLiod ey op smoo ny ‘(sone Jo aseq Op) SoporE 


UONWWOSUOD ke] e XIId Sep Sedipu! $a] JNOd aHepuos ap suejd : ueWHAa// }9 JAAeS7] ‘JUST ‘UeWULOG 02Z 


ansoyejeo ne GqX-[00-ZI .N ‘epeued onbysneg 


Sd] SNO} Op dV Ne saye}o} sasuadap sap % [6 19 % €B INUD 
juoTejussoidal aseq ap sosuadap soy ‘onne.] e oquUe oUN.p 
uosivsedtoo ey mod osononsred souue oun yUuemMp soyqru 
-odsip soponie sap % 19 10 % ES aNUD JUOTeJUOSOIdOI aseq 
op sojorie soy ‘ayne,] IMs s9uUe oUN,C] ‘soguUe XIS Sop ound 
-eyo soyqmuodsip xnoo amp-e-3s9 0 “« aseq Op» SoToIIe So] 
INS S9PUOJ SOOIPUT So] a[NOTeo SUOAR snou ‘anno U_ ‘sjonuue 
SOOIPUI Sop UoUMOUTeYoUS Ied onb IsuTe UdWID}D9IIP (YOOZ 
® C66) SUlI9} SUC] Op SODIPUT Soy g[NOTeVO sUOAR SNON 
‘JolNonsed auratqoid 39 sp ayduu09 sed yuo 
ou apme ojuasoid Py] ‘suosey sayne,p no xneuIsiuoO synpoid 
So] Inod synyysqns sop jURIANOSESp Ud sUTaTGOId 90 ke JDRF 
OMe} op SUdAOW Sop JOANO op JuRLOdUII ys9 ]I 39 ‘apotod 
ud opotied ap syiejied syuourouedde sap mmu9}qo,p o[foyyzIp 
JUDUUD]e.19U9B }S9 [I ‘onbyeid U_ ‘soouUR xnop say sa[qruodstp 
QUdA op yUIOd-sjoJe sUOSIeUIQUIOD Soy] JURSTTN Ud spe] 
-Jodns uou 39 syyepiodns soo1rpul soy gynoyeo SUOAR snou ‘SaAIS 
-saoons soguue .p oiled onbeyo mod ‘ednois onbeyos mog 


‘(€) 9 (Z) 
SoLIos9yv9 Soy suep sed jURNUSI OU soploy soeor 
-90 Sd] OMIp-e-389,9 “(CQ) « SomeUIpIO »» soyeai9o 
(7) « Sadi » sateaig0 
(S1) « Sadtons »» saTeargo 
(D) sapneyo sojegigo “| 

: sodnois aenb ua d9staipaqns 939 & Jounofap ined 

Iod sayeei90 op uoneindod vy ‘apnya ayuosoid ey mog 
(6661) Aleg AoA ‘ootuidoidde uou no jsa someyun smayea 
sop UonesI]yN J soyjonbsa] snos saouvjsuooMo sop UOIssNdsIp 
oun mod ‘ajqeuuostes snyd suN{OA UN & yINpdl say 39 SoQUUOp 
SO] SSSI] SOTTEIUN SMITeA Sop UONeSTTN TJ “Jornonsed sponse 
un .p « uasoul » xud np jyvoyTusts snd 9] suas ne ayo-jnod 
yuepuodsai109 (stow un ‘aydutoxa sed) sapotied soymoo op 
IS sagmnofeo saseyUN smeyea say “xd oum09 3b ER 
fade DSI Gee: aif A4lDIIUN Anja ey 9 9yQUeNb e| op 
MO]VA SUILIOD STOUT a] JURINp SonpudA +b “47 = easy? 
sqjuenb sap ouwuwios x] JURSITQN US ‘stow UN mod sonbrun 
suenb oun yo xud un ud 7 souTeUds ayenb ap sported 
oun mod sayjuenb soy 3a xd say IMs saguUOp so] SUTQUIOD 
SUOAR SnouU ‘JoIfNonIed ayU0A op yulod un suep (WeULIO; 
‘odAy ‘onbieut op Y¥ oralfnonsed uosteurquios oanbeyo 
OIIp-e-]S9 9) ojorre onbeyo snod ‘4 saguue | op JOLIAgy Inog 
‘JOLIAQ} Op SoQUUOp xe Sd}ILUI] SOWUOS snou snou ‘syITeU 
-UOSIVS BT SP SUONdITdWIOD soy JOA Inod jo s{qQeuUOSTeI 
QINIWISp SdgUUOP op SUNIOA 9] onb UIPY “oULID} SUO] Zasse.p 
xlid sop soourpua} sop smjqeia,p sitused eB snou saguue 

xIS op oporiod oun ms jueyod saguuop op s[quiosua, J 
‘siormnonszed 
SIND}LUINSS.p JUSUd}IOdUIOS Ne jo BseUUOT[HURYDS,.p sopou} 
-QUI SOSIDAIP Op s}oyjo xne Juenb syuswassionejos syuvzyio0d 
-WI.p Josdedop ev oo-jnod suoJoALUe snou ‘syinpoid sp sues 
-O19}9Y SUR'S O]SPA 9UN JURIANOD xnegoys xd ap ssorpul 


Ao 


6LC 


xne ‘a[dunis uodsey ap ‘syey[Nsai sou JosTje1ouss sed suorssind 
ou snou onb ualq ‘ouoq ‘sue xIS ap sporied ek] ap simoo 
Ne soJUdsIOAIp Zosse xUd sop soouRpUud} sop JOAIOSQO .p 
youLIod S}UUII]T SIOATUN 399 SWIOU ‘SIOJaNO], ‘JUWIONSoI JUOU 
-oAljejor onbrydesso98 ourewiop un suep ‘soyeoi90 sop Inj{9o 
‘symuty SouaTedde ud sIdATUN UN UOTWeAJaSQo .p dureyd sod ve 
apm] ‘ouog ‘Woy snd ajLI99p spoyjout ev] Jed saguUOp sao 
ap Imied & sodomy 919 JO saToroIyHse « suoneindod » saq 
(000Z) UOspreyorYy OA ‘stup)-syergq Sap DdI.] SUP 
SOSUUKIS SOSUUOP Sop JOIBHUT.P d][QIssod sod [IS IJOUTULIO, 
-OP Op ONA Ud UASISIN ‘D'V 9191908 eB] B SOQUUOP ap d][qUIOS 
-Ud,] 9JOYOR & SONSHRIS JOqey] JO neamg ‘S'~) IJ ‘oureyod 
-O}9UI UOIZ9I spueIsS ouN .p ‘sgnsyUOd sreul ‘saoredgs souoz 
SION sup (0OT B® S661 9P 9poLigd ve] JURIANOD JoUNSl9p 
yyod mod sayesig0 say IMs soguUROS sadUUOP ap s[qQuIaSUS 
un jso 9pnjd,] s0d sayjonbsa] Ins saguUOp Sep 9d0:MOS BT 


gediourid opnj9,j nod uoyneindod ey] °z 


‘QJa “Dd SOlI089}e9 SdSIOAIp Soy Inod uoyendod sp soorpul 
So] yUOJOUUOp joTdtu0s yustaddoyoAsp 90 ap suonoRNUOD 
Sx] ‘uonrindod x] suep sajonie sap ajojoj pj Ins sympoud 
Sop JO SOUIWOS sap aySTxo [I YuowoAgUg “‘[] e onbidde_,s 
YC a Cer erwes Nov nteN Aen ii ane E Miele legis SI i 
max '{X op uonersiqe oun yey us jso “< OUIOS 
sun imod uorssoidxo,| ‘feqojs uonendod op dsolpul., op 
Sed 9] suep ‘oUOg 7(adn) sseuUOT[HULYDN .p oeUTd gy1UN | 
‘olotnonsed sauuoyyueyse onbrydeisogs uolse1 oun suep 
amis 39 ‘¥ aoNonIed ouleyd oun.p onsed yuRstey sUUIOD 
ayissejo ‘f sJoinonsed ayuda op yuiod un suep npuda jso 
1 gore | ‘ayno ug ‘apuess snjd o1Ios9}e0 ouN,p s[qQuIAsSUa 
-SNOS UN SUIQUI-OT]9 Js9_-2 NO “(¢ UONDES BT MOA — « JBJS 
-s1dal aponse » no (saqUa.p NBdATU op joe) « NV» un) 
2 aU089}e0 ayNed oun ve yuRUDyIedde 7 ooNIe UN aJUdSoIdOI 
«1» “(p B Z SUOTDES xNe spd] ap sdioo a] suRp sIqIO 
OUILUOD SUOISIOYD snou onb) .f JOYSI Ip ddIpUT,| Ip a]Joo 
aonb aj} synuoy oun suep ‘ouog ‘je[dwios yuowaddoyaAsp 
Ing] nod ¢ UONOES eT Op UONRIOU RI JWOIISsoOgU sTeU 
‘sojduuts o9,P UOISN]]I,| JWOUUOP soyNUIOJ sag - DION 
‘(soquenb sap jo xtid sap 
gisop un & UOnRSoIse) VW oxouUR | e JUSS mb sopnutoy 
xne JUSUISULIOJUOD ‘oUTeUIOp a] SUP stIdwOd sane soy 
sno} op soyQuenb say ms yo xLid soy IMs JURSE ds Ud sogTNo]eo 
yuos Jolnonsed ourewiop un mod saqio say ‘sayqissod 
SO[GID SOOIPUI Soy TuIed osnyouT vias sdI9puod anbiyawoas 
auuadow ek] Juewodut yoyja un MoAe ynod uoNeuNsd.p 
a]qrey snd oy] neaatu oy onb anbrpul yo (666 ] JWT 30 JOALIT 
‘UeUIOd) smMowajue syoIoyooI op xnevaey sop onb je 
np 3o—-anbiyjawoas auuatoul— stuy)-syeyq XNe SOst{yN soiey 
-UDdUIQ[D SyeSoISe Sop SULIOJ LV] Op NUd} ayduioz ‘uoryendod 
op JHepiodns sorpur.p saynusoy sop oun] e sed ayquiassel ou 
INDLUII}SO | OP NUIOJ v] IS ourgUT ‘(¥sIADUIOT, Op No JOYSsSIy 


900Z eiqwesap ‘ajenbue.p senbiuyoe | 


Op INJoo JUSWIOT[ONIIQeY) d[QId SUULUOD JHeJodns soIpul uN .p 
xIOYyd Np MAR} Ud (L66] VOMoIq) sqHUasgid ono yUOANod 
syuoUINSIe sopljos op stew ‘solAadse] op sIqId dsdIpul 
un mod jua}do sked sop yrednyd eT ‘synejsodns saorput sop 
un] 30 sosAodse’] op dd1pul,| aud MsIoyo ke JUdUOTTONIIQeY 
DUINSOI 9S I[QIO S[QUIDSUD .P SOIPUL,| JUBUIBDUOD jeQop IT 
"V oxouue | B SoguUOp 
yuos ‘9joyoe pone] ‘2 39 aJUeMOD opoliod eT ‘T+ 4 
‘aseq op opotied ey yuejyuosoidor A syuesodxa soy soar 
‘SQOIPUI S90 Op SdTNUIOJ sar] ‘sasoyjodAy soo sed yUd,Issoo9U 
ou ‘saporiod xnap say mod (sosuadeap sap syed no) sayquenb 
Sd] Ins saguUOp sap Ins yUasodal nb ‘YsTeAA dp 39 ISIADUIOT, 
op “Ioysiy op « syyepiodns >» soompul sop soynulioy say] 
‘sda Np sinod ne sjURJsUOD dINOWIAp sjoHIe onbeyo mod 
sosuodap sap pred ey onb uosey ayo} op ajayoe JI.nb saynuenb 
so] ajsnfe mnoayeummosuos ay onb asoddns ‘aseq ap aporiod 
eR] B@ sosuodap sop syed say sed oispuod yuowazjonziqey 
‘(« anbigauoas auuadou yy nO « SUOADL Op» No) onbLy 
-9UI09S3 SdIPUI,T “| epouigd ve] Be Z opotiod e] op soynuenb 
so] onbydde oysseeg op myoo onb sipue) ‘(« ayUemMOD 
apotiod ») Z apotiod vy] Ins (« aseq ap spotiad ») | apotod 
eR] op sayyuenb say ayoloid sosAodsey] op soipul,T ‘syneyol 
xlid sop uoneuea ey wos onb ayjenb ayuenb oweow us 
SOPOIIG SOUIQUI Sd] JO}OYOR Pp JUONUTUOS SINd}CUULUOSUOD Soy 
ayjonbe] uojas asoujodAy,] done soyqneduros yuos ‘ayoseed 
op ‘sogsiyn yuouonbey surtout ‘sayjad 30 soidodse] op 
sogXoyduis yuourtuanbeyy soyNuJo} soy “« OxIJ UONPUTUTOSUOD 
op Jord» eB soorpul soy “xuid sop uonerea ey e asuodal 
ud « UdAOU»» IMdyeUTUIOSUOD Np yeyoR.p JuouoyIodwo9 
ne juenb sasoyjodAy saquoigyip odAe soyqneduios juos 
SOOIPUI SIDAIC] “O.NNe oun ev opolod oun.p xud sap UOneLIRA 
eR] Jopnoyeo mod soynurioy ap sopeLAu sap yuonUoS xd ap 
SOOIPUT Sd] INS DINjeIOYI] VT ‘Sajgid Sao1pul Sal ANS aJON 
‘UOISSNOSIP 9UN 39 ;eUTY SwINSEI UN pusidu0S 
Q UOIIOIS VT ‘IIMLJUDUII[9 SOIPUT,] OP I|NULIOJ Vv] 19 ISeUUC] 
-[Hueyss pp spoyjou ey Jorjnonszed ua ‘saysoidde xnop sap 
SOJURSOAUIOD SASIDAIP SOP S}O]Jo soy Josesap op JoAvsso.p 
ynq mod ev ‘¢ uOoNdIS BT B OYLOOpP ‘TAINS Op spNd,7T 
“p UOT}ONS BI B SQUSOId JUOS 
‘onbruuryiq oyooidde | e odeyueAr.| yUoUUOp Inb ‘s}e}NsoI 
soJT ‘oosy]yN uoneuojur.] e yen e mb 990 ua oajqissod 
aonb soyesa Issne sonpudr juos sayuaLmouos soyooidde 
So] slew ‘(ayeapl UOnENIS eT ap aJ1ed9 snou INb 99) syHRIOI 
S}NOD so] JonjeAd mod yey 3sd.U YoOJJa uNoNy ‘suone[NuIIs 
So] INS S}UOWIOUSIOsSUdI Soy JWUIMOJ JO “« TUP-oUNeAOY >» 
np 39 « SIUP)-S}e}q » SOP SOISOTOPOYJOW say asodxa ¢€ UOTDIS 
BT ‘3IqIo uonefndod R] Op UOHONYsuOS ev] dUUOP 7 UOT}DNS 
eI ‘p & Z SuOTOSS xne 9yLID9p jso oyediound apmd,T 
‘ayjod snjd asepuoses TAINS op opnyd oun 30 oyedroutid 
apnjo spueis oun ‘sopnys xnap Ins oyiod aporse yuosoid aT 
“NUUOD d]qIO doIpul un e yoddex red uoTeUINsa onbeys 
op ossaysnf ey] Jonyead,p ‘atqeynbe yo atjqey9oi1d omsou oun .p 


ansojejeo nv GqX-[00-ZI .N ‘epeueg onbysyeis 


uoXsour ne ‘sojqeded suoLias snou 30 snssoooid xnop xne 
MOWYJe WeJos Jospng suUIgUI dT] “S}NOD Say SUOLION]|eAD snou 
yo uUNdeYD sp UONPUINSS.p jo oseUUOT]HULYDS,p oxo]duIOS 
snsssooid 9] yUOWOIOUD suOLIoyWUI snou ‘sXed xnop 
op ‘suosip ‘soyooidde soy Joreduios mod 4uawoyeap] 
‘SOPOYIOUT SOSIOAIP JoredWIOd ap anA Ud sonduOd saoUdII 
-odxo soy yuonbrjdwios sayne sosnoiquiou op jo saynoyyIp 
sod onb yuvuuo}9 sed jso,u [I ‘xd op saoipul sop jnoyeo 
9] Inod sogsi[Hn UOHeUINSS,p jo OSeUUOT[HULYDI Pp sopoyjoUl 
Sop oIxo[dwioo ve] sUUOp jURY ‘sUOTOINSOI soyURVOduUII.p 
JoIssoo9u jreMod uosrereduios ap oUdS 90 ‘jayjo ud “Iored 
-W09 soy mod sastid ano JUOATOp soJoTTNonIed suonneoeid 
Sop ‘SIOI[Mu sop pWusMoJ ud anne oun,nb jo ‘suoy]HUeYOS 
sonbjonb no uojyyueyss nos un nb yumMoy ou spoyjow oun 
IS ‘OUIDU (J “SOUT JUDUIISNOLIIS }Sd SOPOUJOW sop UOSIeI 
-eduioo ey ‘sed yey oy OU one ouN.nb sipur) ‘onbyeid us 
sojqruodsip ong sed ou ‘ayer ua ‘sotqnudsosns (uoryejndod 
op) soguuop sop sims ‘ojdwioxo sed ‘omndde.s osevuuoln 
-UeY9 ,P S9poy}ou sap suN.] IS “« satquyinbs naf np sayser » 
Sop IUdJUIeUI op g}ISssoogU eI 3SO UOSIeIeduIOD op olUas 
30 yuRSIe} apna 93n0} osod onb saynoyyIp sop sun, 
‘(soyJ9901 Soy ‘neaAnou op 
‘WSO o]][Ie} op ommsou ve] no) (dd) a]]Ie ve] ev o][oUUONIJOdoId 
MNyIqeqoid saae oseuUOT[HULYDS | 10 (spa) aydums 9110} 
-egye oseuUO][HULYIS,| MWOARS we ‘soysT{Iqeqoid soyooidde 
sopuvis xnop onb syzej[nso1 sMaq{iour op suuop “uoTye~ndod 
eB] SUep (SddIaUaS So}}O901 xne je) & INb 90 Ud) syUR}IOdUTT 
snjd soy sopore sonbjonb sap oseuuo]nueyod | o11Ip-e-}S9 9 
‘(suyjdups ffojnd) « UOISNfOUI.p [Mes sdAe sseUUOTI 
-uevyod »» | aonb ronbiput ayquuas ‘(666 [) NYS 39 soopsoddg 
‘ueeyH op sed aylioap ‘addy 99 op opmjod ou~) ‘snuuoOd 
uonendod op somourered xne sjeynsor soy Joreduiod jo 
JOIDJUL.P SOIPUT,P SUOTIELUNSS SdJUDdIOJJIP dIN.SUOS “UOTNR] 
-ndod oy00 JouUOT[HUeYDS Inod sapoyJoW sasJOAIP JOSTPHN 
sloye@ suoAnod snonN ‘nuuod sd Jool xd sop ddIpUT.] 
soyjonbsa] nod suonoesueyn op sojsijeoi suonefndod sop 
olM.suod Inod soesi{Iyn 9.9 yUaAnod saguUOP ap d1UdS 9—d) 
"SINSUULDS OP S9}0OP 9}U9A ap syutod op UOT[HURYDS puLIS 
un SUeP dDUUOP d11089}"9 dUN SULP SNPUDA sooIVIe Soy sO] 
op ‘ollepeurlopqey oseq oun Ins yuoWaToMIqey ‘soyUeNb 
So] Ja xd soy yFUDUUDIdUIOD SagUUOp $dd “SIND}VUIT}SS Sd] 49 
aseuuo][nueyos p soyooidde say Jonyead,p juopgooid sues 
UOISed0O OUN dJO ‘sMa]Ie 39 STUP)-s}eyq xne ‘saauUDIS 
SoQUUOp dP dJUDN9I JUOWDATLIOI oqytqruodstp eT 
‘aTqissod 939 sed vu UOTeNyeAd 
oun,p ona ud UOTMUeYDE.p soquUOp op Med ke dTJOIOH 
-e uoryejndod oun.p uonoNysUOS ev] sWIQU onb 9210s op 
‘snpuda soponie p sazyuonbh soy MoAes e ‘uonerndod ap so1p 
-UI,] Op Sapo sJUDWIDTA sop UN] Inod syeuUOT[HULYSS UONeU 
-Joyul.p sed osurgur osodsip ou uo ‘seo sap yednyd ey] suep 
yloIomMs oq {« ]J9901 IMoTeA » ey e YWoddes sed uoTHUeYOS 
uN INS Sogseq SUOTVUINSd SOSIOAIP op dANPIOI assaysnf 


UOI}BWWOSUOD e| e XIId Sap SEdIpUl Sa] JNOd eBepuos ep suejd : UEWHAa// Je JAAB97 ‘JUST ‘UeWOG Q1LzZ 


“OSOTZ ‘STUN-SIRIT ‘VA ‘xbpey ‘AVISIOATUL) UOseEPy 98100H ‘sorstye}g [PUONEIndUIO| JO} JoyUD_D ‘uRUIsOM PIeMPY ‘OBST ‘STUAQ-SIRIG “O'd 
‘UO}SUIYSPA\ “AVS “PONS ,L OOF ‘SosHRIg UOHeOdsueI] Jo NeoINg “S°7) “WoT soruRL *71ZOT “STUA-sIMIg “O'C “UOISUIYSeA\ “AN OAV SHOsNyoesse 
Z ‘sousneIS JOgey] Jo neaing ‘SQ ‘suUOIIpUOD BUIATT puR SodLIg JO 9dIJJO “IaARIT ‘'D BIATAS 10 YOIKasoy Spopa[ AdAIng JO soyJO “URUJIOG “H URTY ‘| 


eB] op sosnf uo-jnoed yuour0d ‘siopy ‘sonbissejo uorefndod 
op OIpUl,p sojnuLIoy sop uoneorjdde, onbrijdwos mb 
90 USUIUIEISUOD ILIA SYOICUL 9] INS sopoe p uonefndod vy 
‘WOIOINS AC] ‘d[QISsedoeUT 4S9 [I.Nb syuowsoK]dud .p s1quiou 
puvis Is UN suep sopoe.p dIquIoU pueIs Is UN Ins jURLOd 
suOT}ORSUR.] Op SIqUIOU pURIS IS UN sgo[sUS ‘UOT}e[ndod 
ap xud sap sorpul no ‘saponse.p o[e}0} uoNeindod ke] ms 
yuRSeg 9S Ud g[NO]ed JUDNe{-snos xUd sop soIpuT,| ‘syed snyd 
soy sAed say nod ourayl ‘a[qesiyeos OS UOTeEN[eAd,p o1UNd 
30 onb urezioo sed jsd.U I ‘ol[eor UW ‘soyey 939 JUO odeU 
-UoT]MURYSS,.p sayooidde sasIoAIp sop sATeOI oprynoexa | 
ap suonenyeas.p nod yoy onb so yuRssorgqUI yoodse J 
“O[QeSTe] }10s 
aistiqeqoid aseuuoynueyse | onb mod soiessoo9u snpuscA 
JUOS S]I NO S}IOIPUD SoT IMs 39 snpUdA sapoTe.p sod 
BR] INS sosUUOP Say Soyo} IuDa}qgo wv ev A [I.nb aNoFIp ev] 3S9 
ayooidde ay199 op syeyUSUTePUOF UOSTeI eT “xLId Soy JUSAQTOI 
UIvLIO} op sjuase sap sayjonbsey mod saponsie.p soanoojes 
no soyeisuas sutoul no snd soLiossyed sap UOsSsIsIoyo 
SOP .P SayVNS soydIIp sop saystperoads soy sjonbsoy 
suep ‘osnf ne suolnueyos p imsed e symysuod jos Od] 
sop wednyd ey ‘opuouw a] suep smarty ‘soxofduios saystyIq 
-eqold oseuUO][HULYS9 .P SOPpOU}OU Sop JURSITN Ud sogsTTeoI 
JUOS DdI.[ B Sogtfor soygnbus so] sayno} ‘stup-syeyq xnV 
(0007) Trekoy 39 UeUIOGg FueNTe A 
‘g[duuroxe Jed “oA ‘asepuos ap ueyd oJ ns sagseq sosoujodAy 
SO] 9}S9JUOD vB [[RAOY Op « a}sTUUONSIpald » sasuad ap 9099 | 
‘JUOUIIDDOI Sng “oyqelayoid oo ‘ayqetA Uoydo oun SUT 
SIOpIsuod 31e}9 « JHeUOSSIdoI»» NO « 9UUOSTeI xIOYO Jed » 
ssvuUoTnueYO | “sf9IS XK Np mqep ny ‘osmboe sod 
anud} 939 smofno} sed vu aysoidde ayaa (7661) UCUMOI 


30 UOSSUBMS ‘TepuRS ‘o[duuoxe sed ‘MOA ‘« adepuos op urd 
un IMs 9seq » no asT]IQeqoid sseuUOT[HULYDE UN dIIP-e-}S9 ,9 
‘JIoIpms yndA uo. onb uoNeindod sp sonbysugjoeres sap 
yolns ne ssouDsIOJUI Sop oe} Mod oMOJegTe JUSUII[9 190 Ms 
Jopuo} 9S B 39 SSEPUOS Op Snssod0.d 9] SUEP oMO}VOTe JUDUIDTO 
UN JOOOfUT B JUOUTATPON|IQeY 9jSISUOD SNUUODOI JUDWUIDTRIDUNS 
snjd ev] oseuuoTyueyos.p oysoidde,q ‘osnf ne oseuUo] 
-[QHueyos no ‘ouuUOsIeI xIoYyo Jed aseUUOTTWURYII | 19 9)STIIG 
-eqoid aseuuojnueyos | : xd soy JOAdJOI Op onA Ud ddeU 
-uo]]Hueyos | op soyooidde sopuvis xnop onsuysip uO 
‘syegap op jolgo | yUWATeS9 je} ‘SuOneIopuod sap udAour 
ne ‘xud sop suoneliea soo op uonesaise p saudoidde apouy 
-OUI BT “« SOIIPJUSUII[9 SOOIPUT >» SOT dIIP-k-1S9,9 ‘sapoIIe.p 
sol10s9je9 soy nod xud np UuoNeLeA ve] op sofduis smoyeur 
-So sIoatp mused otidoidde xtoyd ne yuenb suop yimsmod 
as yeqop I] ‘oseuUOTTHULYDE.p splod say mof ev mud} op 
d[qujuor usAOUT op sed yUOUUDTTONAIQvYy 9}STXd .U [I ‘ouasOUIOY 
yso xtud sop juauaAnout a] aonb asoddns 4sa ]I yop saponre .p 
sodnois sop omp-e-js9,9 “(« sapoe Pp sayeys » no) « saytsod 
-UI09 soponie >» sap nesat ay snog ‘« suoyeispuod » soy 
‘anne | 19 xlid soy yURUUOp oun | ‘sojgnbua xnop suTOW ne .p 
jueusAoid saguuOp sop Ins ssodai—sjquiasua Pp Dd].] oP 
INDCUIN}SO | — SUT]N M9}euNsd "J ‘aynop us sasitu jo sansiq 
-le JUOS ‘sapoTe soy 39 SoyNUeNb soy *xtId soy oMp-e-3s9,9 
‘S]N.IG SJUSIPSISUI Sop SUOTIIUIFIp Soy “‘NyeQep 1So sponse sap 
guidoidde oureuop oy “IMUIZSp & TIOWJIp 3S9 sPQlo UoNendod 
ey] ‘soonbryduios snjd soy aseuuoyHueYyse .p sostidanua sop 
oun ,J syuasoidar (Od]) UONeUTUOSUOD x e& xLId sap soIpUT 
uN TyqeI9,P oA Uo dseuUOT[HURYOY,| “UY eB] B INqop NG 


ayxowU0D *T 


‘JHeTJodns sorpul ‘saguueds soguuop ‘ouUOSIeI 
xioyo Jed osevuuoyNueyse Sayre} ev] e aJouUorJodoid sy]Iqeqoid saAe oSeUUOT[URYOS ‘olIeyUDUID|[9 SOIPUT 


: SQTOD SJOJ 


‘uonendod ry] Ins gseq UoeUMUOSUOD Be] B xd sap JHeIIJEdns sorpul 
UN,P ISRIQIO Np s[eqo]s opNjMoeXxo sIMOT[IOW UN ILYJO JSTQuIdS TUP)-sUINeAOY NP sopoyJoU soy ‘s}USIOTJIP sMoyeurtso .p 
UOHeSTNN,| IAB STRUT ‘“OT[[IONde1 UONPWOJUL.p gyWUueNb owWeU e] InNOg ‘TUp-sUINeAOY ne og}dope guUOSIeI xIOYO 
Jed oyooidde | 39 stup-syeyq xne ogjdope aystIqeqoid ayooidde | oAes & ‘UOTRUIT}Sd,] op 39 OsepuOs op ueL]d np soydoidde 
xNop op syeyNse1 soy suoredui0s snou UoneUMss,p 39 s8eUUOTTHULYOS,p sapoyIsuUI sosIdAIP JUR[NUMIS US sind ‘saTeo190 
Sd] INS saguuKdS SaguUOp op ANJed e xud op jo syeyoe,p « SIOATUN » Jed UN JURSINSUOD UW “xLid soy Ins seguUOp S9gq I][IonNdeI 
op ona uo shed sJoAIp Jed sagsi[yN JOS Jo SOO9PULUTLUODII JUOWDAIA 939 JUO— QUUOSIeI xIOYO Jed oseuUOT[HURYOS,| 10 
aystjiqeqoid aseuUo]]HURYSS | — odevUUOT[HURYDE ,p snssodo1d Np sayUdIOIJIp JUoWIoyeJUOWULpUO} soysoidde xnaq ‘sasuadep so] 
Jed uonesgpuod ey ‘onne] 39 xud soy yueUUOp oun] ‘soygnbus xnap suIOW ne.p jueUdAOId SOgUUOp op UOSTeUTQUUOD Pv] JOU 
-gye19ues3 pombe ya snbrjduios zasse yso (Odg]) UONeUUOSUOD PT & xLId sop SOIpUT UN JOWISa,p oNA Ud dseUUOT THULE J 


puINsey 


, UBUIS9AA PAVMPY 30 JIAVI'T “5 VIATAS UOT ddIUEL ‘URWy.10g “H ULTY 


UONVUIUIOSUOD LT & XLId Sop SodIpUI Sa] Anod ssepuoOs op suL[g 


LL? 


anbojeyeo ne GdX-1L00-ZL .N ‘epeued anbysije}s 
6€7-LLz ‘dd ‘Z .N ‘ZE IOA 
900Z eiqwas=ap ‘ajenbue.p sanbiuyoe | 


‘T11-66 ‘97 ‘ajanbua p sanhiuysa J, “suaty 

op osejsidop e aseuuoT]HUeYE .p suvjd sop yuRyOduI0d Jo sJapoul 
un Ins s9gpuoy uoKeWNsYA (0007) ‘O ‘Yuely 1 “ys ‘UosdwoyL 

"8S-PE “9¢ ‘anbisojo1s05 

alsojopoyjayy ap uljajjng (AYM pue yeUuAA ‘SsUsISOp SuloKy 
-yul] pue ‘suoyerndod usppry ‘suonendod oiey (7661) WW ‘Ueesds 


‘OL 
“6S ‘9¢ ‘anbisojo190§ aisojopoyja~y ap uNaljng {YSIOM 0} MOH 
:So[duues [[eqmous Jo siseq oy} UO UOneUISY (7661) “AVL ‘siopftus 
WES Vopuo TT uenp? 
aug? @2UDpunqp joulupy fo uoyounsy a4. (7861) “AWD “19998 
PE-LT “6b ‘swa/qosg jo1205 ‘suotyetndod 
uappry Jo soyduies yeuoyol-ureyos wo soyeumso uoneindod prea 
SUIALIOG ‘]] Suldues usatp-juspuodsoy ‘(p661) ‘G'q “WoueyxoH 


ansojejeo ne GqX-100-ZI .N ‘epeueD onbysneisg 


“LO-ES “OL “SIUSUDIS 
joing fo yousnor ‘suydures jyeqmous Suisn suonejndod 


Uopprly JO ozis oy SuNLUMs| “(P661) “AVL ‘siepitug 19 “OC “yuery 
“SOH-E8E TIT 
‘Vv ‘Mja1s0g joousynjg jodoy ay) fo jousnor ‘syst, aydyjnur Sursn 
uoNeUIse ozIs Uoyendod 0} soyoeoidde uersakeg pue [ado] H[NUwW 
[eoisse[ (6661) “MA “JOxUNE 30 “SW ‘UosuYyor “q'g “Broquory 
"8¢-61 ‘07 ‘SousyDIS po1n1f{O fo jousnor ‘suoye;ndod 
uapprly JO dZIs oy} ayeUTSa 0} SuT[dues SuIDe.N-yUT] pue Surjdures 
Jsnyo SuTUIQWOD (F007) “W'S ‘Vosdwoy] 19 “HW “eUIps|-X119q 
‘OVI-TEL “I ‘SousuDig jojuauuosAu 
pup ‘joosojoig. = ‘Joanynousp fo joudnor —“sJoyeunso 
oimdeses-omjded 0} [eAIOJUT soUSpYUOS paseq pooyroy!-syyosd 
Jo uoneordde uy (9661) “AL UeHg.0 19 WH Wry “yW ‘sueag 


soddei6 ua je sual] ap abejsidep ued aHheuuo}ijUeYyDS,| BP UOSIEUIQWUOD : UIpueluOW Je eUIPS|/\\-x!|e4 OZ 


angoyejeo ne GqX-[00-ZI .N ‘epeueD onbysnes 


"Ssolg AVISIOATUA) PSPLIquIRD : YIOX MON ‘suoypoyddpy 
ay) pup spoyjapy do.ysjoog (L661) ‘A’C “AePtuH 1° “O'y “UostAeq 
“6SE-EPE “Sh ‘DyLuauoig ‘uone|ndod pasoyo 
v JO UONeUITSY :] snsuso sinjdesos-[dynut sy “(8S61) ‘N’f ‘Yooueq 
‘OIT-L61 ‘L9 ‘pylajawo1g ‘uonendod posoyo v Joy Sutures 
aindesor-ajdyynur Jo stsAyeue ueisokeg V (1861) fq ‘oulpopseo 
‘687I-Z8TI “68 
‘UOLJDIIOSS [PIYSYPIS UDILAOU ayy fo jpudnor ‘suonendod oyu 
Jo} spoyjour densjoog (p661) ‘d ‘TRH 1° “MY Fopng “OL Yoog 
OUT “SUOS 29 ATI UYOL : YIOX 
MON “WOHIPP suyl ‘SSAoUp BDC’ [pa1408aIV) “(ZO0T) “VW “HseisV 


ary dessorqrg 


“SJNON.SUOD SOITLJUSUIUOD 19 SUOTSABSNs SINd] op 
SINDJVUILULXS SO] 19 B1OOSSe IMDJOepal 9] ‘ZaUOINH oprenpy 
SUOTSTOUST SON “SVfL.1 °P OWHHNT-cO0c SVN -TVd 
uonueaqns ey Jed 30 qqWOUd MP 10-10-AXd-NISVN 
uonusAgns ei Jed ogoueuly 939 e& opmd ayey 


SJUIUWTIIIAI WI YY 


"72 SIM9JeUINSd ,p d]qQuIOsUd | JosI{HN .p outed vy yea 
[I ‘onsvA jsa d]JO IS SWUUU ‘9}09LI0D UONPULIOJUI,p osodsip 
mayoiayo sa] 1s onb suosued snou ‘uepuedsy °62 ap a[90I 
INJ[VA LI SP SOUSIOTS soy NITRA OUN.p Moyne soNUDDUOS 
JUSWUIDIOJ Js ayI]Iqeqoid op oyIsuap ev] yUop 1 ap uOLde 
Io] UN suOUUOTUSU ‘oyduexe .p an YW ‘SUONPUISO soy Is 
soueploul oun vine (,.d sop smo[va soqqiey ap & IOUIQUIOD 
SOUOLIO S[BINIUT UONLULIOJUI oUN ‘JUdO\sofTURY ‘SoNoUTeIed 
SINT Sp sIMoyea soy Jed sagyoajye sed JUOS oU sUOT BUSS 
SO] ‘SOWIOJTUN JUSWISANLIOI SONUdIUTeUT JUSTIOS LOLI & SIO] 
so] onb uonrpuoos e& nb yuonbiput (xneva]qe} so] suep soyuosoid 
sed yuos ou Inb) s}ejynsar say 19 someyuouratddns suonepnurts 
Jed stesso sureyloo 9sSI[ed1 SUOAR SNON ‘S:Md}eUNT}SS soyNe 
Sd] Inod soatasqo dyIIQeLIvA 910} op jo sIeIq op souretqoid 
Sd] JOAN Mod oyUKSJNs sd JUSSSTULMO}J sfI.nb UoeULIOFUT J 
"1 say nod soulloyiun JUSWOALIII LOLId & SIO] Op SIAIIS 
suoAos snou snou onb uarg ‘yuastyyn s{t.nb uoNeuUoOsUr.p 
gynuenb spurs snjd ej ap sousnbgsuoo oun yuos 72 sIMoyeU 
-1]s0,p s[quiosud,| op sayoldoid somorfioul soy “UyUg 


‘JUoWoATOedsal *Q] 39 ,O] B SeINoLIadns smoyeA sop yuanbiput 77 yo "T° ,OI & Inotiedns 
no juesou yeyo 1 op juepuodsoxioo moyeumso,] sfonbsay mod xneo yWoTe}9 STWUO sIessa sa] ‘stesso sap %g ap ajdtuoo sed yueUD} 
ou Ua snuUa}go s}ey[Nsgx sop onbipul Y InaLigdns sorpurT ‘stessa ,Q] IMs seseq syey[NsaY “9[noyeo uoU ‘ON ‘de.ys}oog suoyHULYDE 000 Z 
Ins sgfnojeo deys}oog souRTUOS op soT[eAsayUT “WowWsAydodsor “ueyd a] Ins sopuoy jo S[QPOUr os] INS sapuoy soURTIeA op sINoyeUNT}sa 


sop yuonbiput 2 yo “2 ‘'s AWA sop G 19 FW Sinouodns soorpul say ‘aAyeoI ouUAXou onbyespenb mous ‘ 234 Juejar steiq ‘qi eION 
O10 100) SO" S0.0— IV 0s 100 .cr 0-500" ILO.  2O0- FLO SO0m re 0 C0 0 ae Om OO a 
910. 100s LEON O0 0 AV: 100m Cr Ove OLOw Cl Obst C0i0 91.0) pon LOM eal O Seek Omnis omen OD) S 
LEON Ow VLE OigeSO'0! BSC OM ASO0 >“ CSOhOLOM LTO’ TOO 810" 200) “TO 100 Oca ce r 
OF TOIN SHOR IEHON W PC E50 ONO 0S E89 OTRO OFT 20> 990 <COmaerOy e0'O= 060" 900 ry 
OS, Cl0= sl SCO 650. > 00-2690) “EO HOV LEO 990m SCO FeO. 20-0 -e le Onmrant i 
950 PO0= SEO .000. 800, 800 050) 9710 LUO anlOD=mG Om eS0iO pT OganchO, 10 990.0 Ie 
v9 DT OPIS ON TION. MOORS ETON PY OT OCR FETO'T SPO “100. T9010 ar 
vo. 94 OF TY BOE 0 E7909 000 C60) HCC Oe Os eel OF ich w OP Ose 10 Oe CoOec iO) ne 
LEO PO OP PLEO” AFSO'O PSCOM 900 M1CO SPT OPV HLT 0M T1010 son 0° e010 1 OP hi Oc 0 ee 0 at 
peo) el ail a 19 0 600 a0 We OGUE eet S26. Pal sro «6-100 S190) SIO 
oS) eel al ea PO'08 STOOP POET OCOP ges eal a a 6 OU S100 NEZO-O MAKOTO G 
LEO LOO= 20K0.. p50 Or 8:0 0. Oc OP Ops 800m £10, 000F LT Onn cO0rn fl 0. MOU eGLUs eG at 
25 GLA ON ON 19 ORNPZO'0 ON ON pos tale ON ON 8r0 =6100 =—ON ON * 
oe aT ON ON 790 + 7OO0- ON ON 2S meal ON ON 6r0 100 ON ON nt 
$90 79'0- ON ON Le0rs KOO maON ON 80.0 r0'0- ON ON DEO AOU ON ON nt 
oo ga oo ga cr ga a gi an ga eb ga or gu OH gu 
JojAe L de.ysjoog JoyAe | des}oog JoyAe dens}oog JoyAe |, de.nsjoog 


z00‘0 = “d ‘100 'd 100 “d ‘soo. ~ ld 


[J uonendog 


Z00‘0 = “d ‘100 'd 100 * “d ‘so‘0~ 'd 


] uoneindog 


SOULLIVA OP SINDJLUINSS Sop SANLIOI sUUDAOW ONnbyeIpenb India| op 9911Vd OUTOvI JO JRO sIeIg 
p neo[qe lL 


GLC 


900Z eiquwesap ‘ajenbua.p senbiuyoe | 


andojejeo ne Gq@X-100-ZI oN ‘epeueg onbysyeis 


‘quowoanoodsar “Q] 12 0] B SemNoLadns smensuo] sap juonbiput 
7 10 '7 ,01 B mouigdns no syedu yeyg ©2 op yuepuodsaxioo moyeurNse,| sjenbsa] nod xn9o JUOS SILO SIessa SI] ‘sIeSS2 Sap % g 
op ayduioo sed JuvUd} OU Ua snua}go s}ey{Nsay sap onbrpul » moLiedns sorput,T ‘stesso ,Q] Ins sgpuoy syey[Nsay “9[No[e uoU ‘ON “deys}ooq 
SUOTTHURYD? (NO Z INS seqnojeo dens}oog souRTUOS op soyPeAroyUT “jUotUAATOadsox ueyd 2] IMS SppUOJ 19 BgPOur 9] Ins Sppuoj souRTUOD 


OP SoT[eAJoyUI sop yuonbipur 2 yo “2 ‘'2 AWA sep G19 PW SInotedns saorput sa] ‘“ouUaAOUT noNsuoy *] :9INIOANoo op 9yI[IGeqo.d ‘do BION 
OTL OSE 0 H6L9T “00, €S6 COOMUETOMY 126005 PEOA” PPG OP SLSaI OD 17996 $60 9001 L60 d* 
LLS-Vee6 OF OTS 2 O0'T €v6 66 Om O00 ZOO0R £Lo ET’ 760 9051 “OOM 66 S60 L166 L60 ae 
vs9 €60 999 980 ~—s LET COI) pubs) 680 Orv v60 IIv LOO Oct $60 ‘TEI v6 0 a 
S8iseuecl 0. SLC £890 \\iS66 COO ae CLOW OO SLL Ca CL.0 pF OO. C 1n09 Oi LOO ot60: -¥CSO.L9 £60 ry 
GO0'S CLO FLO (090% $86 €6°0| (USOT E60 © hl: ILO) TIE! 850% 866 FOO“ COT C60." <r? 
Eso vo vIY 99911" SG0MN LeINN eso OT ISIOG So0 corso oer cih  Mcaol™ ser) "Sera! MTeT | Sooner 
£969) 060) “I LEO ae Seni S60 WIROEE Wales6.01 S069 3060. “FT cLOU PLS "S60 “PCT A p60 ne 
Shae SO aa CL On Sc S60. SCL 8 V6 01 | L889) 968 0. 1 TLO 8=66VOT «6860 )— OTT Ts 60 it 
Deseo Gaers99 160 LE) ¥60" OST. 260) COP sey hO Ou pZibory 4Z6.0se6CT a S6'0n) ud Elie 6 Our at 
ZOE3 tn 206 Orage I SOewascOiL cS6,0rA6ew loeSGOr- .lOGSaW6 Onna CL Ores CSOs (S60. SL Laden 0 a* 
EVOL R06 ON FT PEO SOCOT BSG OMMSCIS Ww PGOLe 2lISDS0604 Vy rL0 trol S60 OIII +60 a 
LS? 760 79 960 LEI $60 LPI L60 0b v60 66€ C60 *6Cl S60 OCT 560 at 
PSE OOM MEME ON) ECO 1) (S600 ON’ WONM) 0078 000° ON” | ON |) CSN” S60, ON: 1ON 2 
WALL 060,.ON ON 6001 S60. "ON, “ON... 1818 060 ON ON. .tr0l, 660 ON ON wt 
DG) ASA ON MONI YON ps! E0ig5) £607 ON» ON in 866 Gh6Dis ON, peDN¥nn6TlounS60 a NW ON ont 

“4 do i do l do l do g) do di! do a do uf do 
PIeM dens}oog PIeM dens}oog PIEM de.ysjoog Prem dens}oog 
7000 “4 ‘10‘0~ 'd 10:0 = “d ‘co‘0~ 'd 2000 = “¢ ‘10‘0~ 'd 10:0 = “d ‘so‘0~ 'd 
IJ uonejndog ] uonendog 
% C6 & IOULIJUOD OP SO][PAIOJUI Sop SUUDAOW INONSUOT 19 9INJIDANOD 9p 9UT[IGeqolg 
¢ neo[qe 
x0) 7 Inotadns no Jyesou 3139 OD yuepuodsaioo moyeurysa | sjonbsay Mod xnao JUITL}N STUUO STeSSA SIT “SIBSSd SOP % [7 9P 19 % SI 
op cof gop ayduos sed JUeUd} OU Ud snUd}qO s}e][NSEI Sap JUoNbIpUI 2 Jo g ‘vp sInaLIadns saorpur sa] “stesso ,01 Ins sppuoy yUOS s}ey[NSeI So] 
‘yUOWDATIOOdSal ‘soISOp xnop & PUTURD)-UOSSIOg op jo SAoMJor op ‘OULIOJIUN IO] oUN INs soseq suatsakeq. sInoyeuysa sep uonbiput 1 49 
Cz ‘ly smoayeumse sop J 19 ( ‘Q SInotodns soorpul say “AINA ‘2 30 °2 ‘'2 Soatyejar ouuakow onbyeipenb naa ‘ 234 Jueyar sterq ‘gi BION 
300mg 00 0 F COO 0010 200.9000 0 TOOnm000 11°0....600_,..90'0 LOO M10 70-04 900.) 510.6 d™ 
81‘0 100 4 900" "7000; TISTOS 4.000% 900) (00°0 «07 Op Z010 Tye OriCOj Ope 100 Ou 200 S10imne COO 
600" 1002 oO” 50005 ©9010 “TO0m *CO'0S 100:0— 60'OMF POLO Z0'0' 44000 2590 Gale T0'0=1, 20 0M 00 0 re 
Z1‘0 0-200. 000> ILO. Z00=-700 o000- Lz‘0 80°0-“200™ 00> 1270 © 80°0— "100 | “000 
Pe O00 900 OKO Le Os oO. 05 90.08 000s SPO" Vl Or LO). 000s 8P.0 —avl OF CL U, 200 Ua ry 
SON ee tec One rO0 Ose OO. OU LOO 20 0-000 60 09 410.00.c0-0, . OO0= 000 1006. 20.0, 0005 a 
OG Us 010 ba C000, 0006.10 C0 Oi GOO 000mm, 9 Oe sO Omnis O LOOge. 3900. «80 04.2010 ,.410/0 a 
IZ0is CliOr 90'0o" 000) BS90nIOST On 90'OnNr00'0 ga 59 OneeOtKTI'O 100: 590.577 OUST O-7050 at 
Co 00 TOO =*00'0= 790 0% 0010-400: 000" 600" TOO -*700"™ OOO. 0010" "000 =""20°0 -™00'0= a 
ESTO? L700 2KZ0'D= S000 = 1608, %S0'°0" FA0'OY 400075 .cr'O™ 5e1"0 2 L0°0 [O:0" * YEV-O* ZT LOY” TOO e 
Be) Oh 390 O00 00. "L910 LTO MH90 0000" F .9L'OT tic 0 E10 LOO 2820 “PCO! ci 0> 100 “ 
600  100- 200 000- 900 00°0- 720.0 000- 60:0 10°0- 200 000- 900 o000- 700 o00- 2 
734 gu 734 gi 234 gi 734 ga 734 gu 234 gi 734 ga 234 gu 
900°0 €0°0 900°0 €0°0 Z00°0 10°0 Z00°0 100 ‘d 
10°0 500 10°0 s0‘0 10°0 50'0 100 c0'0 ‘d 
AJ uonetndog II] uonejndog [J uoneindog ] uoneindog 
uone[ndod ap sayjre} sop sinojeullyse sop sAnejor suUdKOW onbyvIpenb Mad | op sd1IVd OUTOVI Jo JIVIOI sIRIg 
Z healqeL, 
seddei6 ua je sual] ap abeysidap sed eHheuuoj|}UeYyoS,| 9p UOSIEUIqWIOD : UlpueluOo|\ Je eUIpe/\-xI|e4 PLZ 


ansojeyeo ne {qX-100-ZI ,N ‘epeueD snbysneig 


‘oipuoyoidde snyjd uodsey op sorpnyd O19 JUOIAOP 
inb sjafns sop juos dv.ys}oog say[eAJOJUI SINOT[IOU op UOTTeI 
-Oqvyd,| 19 JeYNSaI 90 op UONKoT[dxo,J ‘UOssIog op Io] oun 
sed juoains ou ‘yy soy aonb no safqrey yuos , pe soy onbsio] 
PIRA\ SP Soyfearoyur say onb suoq issne sed jUos ou 2 
Ins soseq '2 mod deys}oog douRlyUOd op SoT[eAIOUT SIT 

"SO[QeI} SOOUDIOFUT Sd] OIPUDI Inod souuOg JUSWUUUTESTJNs 
sed juos ou 7/2 Jo °2 ap sgatidoud soy ‘stozaynoy "2 AWA 
anb sjeynsei smayfiow ap yuouuop 72 yo 72 suoisgheq 
SINJCUUSS Soy ‘saTqrey JOS aa Sg] Is ‘onb sust[nos 39 ,p 
MLIQU [J “sayqeidaooe syeynsg1 sop yuouuop 72 suaIsgseq 
SINOJUIYSS So] sjnos ‘sMoajovJ sone soy sno} 1d][eU 
J so[qiey yuos | ya so] onbsioy ‘stojamnoy, “syeyNsor suog 
ap ouuop (dens}oog no pre) e8epuos op ued 9] Ms 9puo; 
ad} op dOURTFUOS SP SOT[PAIQIUT Sop 39 2 Sop SIMo}eUITSE 


sop unoeyo ‘asepuos op aseq ey] Jed oyoAnod 1/'2 UOnoRy. 


B] Op ale) eT op 30 ‘PY Sop IO] eT Op JUoUWIepusdspuT 
Jo Sopueis JUOs 10-soyeo onbsioT + yt sop Inepuess ey] 
JO DOURIJUOD AP Sd]TBAIOJUT Sap Jo SIMoyeUINSd sap sgoudoid 
So] Ins onyur mb smoayoey edroutid ay onb omyouos suoAnod 
snou ‘uoneinus sed opmdy. op soy] soy o1sTey[ 
‘syeyNsol 
ap jofduro0s sfquudsud | & We) WO JUOAINS Inb soeJUSUTUOD 
so] ‘sloyoynoy, ‘onbuiswmnu ops, op syejNsel sureysc. 
onb suojuasoid snou ‘p e Z xnevayqe} xne ‘soedsa.p oyney 


UOISSNISIP JO SJBINSIY = °9 


“ouudAOUI 
INONSUO] MI] 39 DINYDANOD op gyTIqeqoid mo, sed % CG 
B DOURIJUOD Op So|[PAIOJUI sap sojotIdoid soy anyTeAd sUOAR 
snou ‘UljUyq ‘a][99e1 souRLIvA eT onb joynJd yUOWONbudurs 
SOUTULIOJOP SOURLIVA kT JURSTTN ud stew ‘Uonendod ap are} 
RB] Op M9}euIsa uN.p xnoo onb uodsej ouUOU BT Op SIUTFEp 939 
yuo mb “sAnejol suuahour onbyespenb mo1a uOS op dae 
SUIDVI PB] 39 JLIOI sIeiq UOS Jed dOURTIeA Op MdxeUITSd UN .p 
sgjoudoid soy anyeag yUOUETeS9 SUOAR SNON ‘Tessd ,7 Np 
SIO] ONUD}gO 2 Op Ma]eA e[ SO ‘2 No “( 24)/ (2 - fy yi< 
= Tuo =n. 19 QQ4j/(a—*2) FO =steiq—1 
yuejo ouOS §stuyap ‘oAnejor ouuoAou onbrespenb 
INDUS UOS SP d91Ied OUTDVI LI 39 JHeIOI steIq Uos Jed ‘2 
SUOSIP “INd}eUITJsO UN Pp saj}oLIdo1d soy onTeAd SUOAR SHON 
‘apoooid 
Inb opoyj,sU eI Op stesso OQOOOT=~ JwesI[WN usa soonjeas 
919 JUO d|[PAIQUI.p jo sponjouod smoyeurNssa sap soyoludoid 
so] ‘uu ‘dens}oog suojnueyos YOO Z JURsTTWN Us snua}go 
99 JUO deys}oog sMo}eUIsa Soy SNOT, ‘SoTWUaO sap spoyjout 
e] Jed sgmnojeo 939 yo Inb ‘2 yo {2 J2 smoyeurysa 
So] INS SOpuoy soyfeAIoyUI soy Jnes ‘aseq op spoyjoW 
RP] UOTIS dvs}OOG SaT[eAIOJUI Soy gyNoyed suUOAe SNON 
‘QOULIJUOD OP SOT[VAIOJUIL Sd] 39 DOULLIVA Op SINd}eUIISO soy 


ELC 


gjnoyeo suoA® snou ‘ano UY ‘JUoWIaATOOdSaI (7) UOSSIOg 
ap 10 (f) shoggos op ‘(Q) ounoyiun sto] soy woud e 
SIO] SUTUIOD JURSITHN Ua snuaygo ‘gq ‘fr ‘Qav “14+ y= 
yo «S1‘'1 suatseheq smoajyeusa.p so[quiasud sIoy sj 
onb isure ‘(p90Z) UOosdwoY], 39 eUIPs-xI[94 Jed gsodo.d 
‘a+'z=2 yo “2d AWAP e[quiesua] : uorendod 
OP Sd]]Ie} Sap SJUBAINS SIMNOJeUIT}Sd Soy Joynoyed nod sagsTyyN 
919 JO saduUOp sag ‘WOUTdAT}OOdsaI “jy re) pt ouuaA0Uul 
ap Inoulog op stoy op mmied e “1 yo ‘w—'r oye) op 
SUOTTHUEYDS sop JuRI Ud SX 1 (iV op Smoyea soy g19U9d 
SUOAR snou ‘UOT|HURYDE,, suep ‘p oddeis ve] op med v 
‘sInNgeA ST=U OP YSSVA UN guUUOTIIIS sUOAR snou aT 
op singeaA OST=N op uoneindod onbeys op imied vy ‘yns 
[I SUID UOTyE[NUMIS Jed doUdTIOdXa | SSI[VdI SUOAR snoN 
FIDL P SOAQUI 
-ered soy yuosuUaUOS INnb spueIs JUOUIOANPIOI SoT[eAIOVUI 
Sd] Ins sagssodsip ustq yuOSs WoOLId e soy soy onb yuonbryduut 
smgfeA so) 000 08= (WA ® 008= (WA OOT= CVA 
‘or=(‘Wa onb ouos op 100= 48 = MT0= 9 
‘T= '0 7 1=7 6 = 74‘¢‘¢-= "N16 = JO Juarey9 songuiered 
sop sinojeA sot AT 3 [I] suoneyndod say mog °,O] 
=(VWA 9 008 7= Va OOI=CWA O1=CMA onb 
eos ep ‘87000 = 9 ‘“P8'L=% T0= 9 T=? TT=¥ 
‘67= A ‘Ce-= "NN ‘¢z7= 70 yuore9 Woude slo] sop 
sonoueied sap smo]ea soy ‘TT 30 [ Suotyendod sa] mog 


eLo=2/'2 7 Q=1/" oF 0=1/"2 Spoaaes 
CLS. Ci ames Ck TLOV=) 102 
004 = % 00L = % 00~7=% OOTT=% 
cigt="  MTigT=4 wigt="  TIgtT=" 


Sp rtT=C(MA TL=CWIA 
Cb nn Calealed ed 


8p bpT= (WIA TL=ECWA 
TL=CwWa TL=CWa 


‘Sou gjeruloulg ‘yy Uossiog ‘W ‘Sou o[eIWIOUIg ‘yy UOSsIOg ‘W 
OST=N OST=N OST=N OST=N 
AJ uonendog jy uoneindog [[ uone;ndog yj uonejndog 


sogynunis suonerndod sap sonoweieg 
JT neslqeyL 


‘“OJJO-sasud sapoul un ,p ssoyjodAy ,| yuRyoUIS 
Ud JHVOYIUSIS UleS UNONe asi[eoI OU UO J onb ‘souR[quIdSTeIA 
op UINWIXeU Np UONeUINSO.| Op seo oy suRp ‘oNUOUT 
® (8561) Yoourq ~(,,¢ ap moyeumso,| op s}ovoyye,] 
Ins soUdpIOUl,p sed je .U UOTRIdI 9999 Op UOTSsTWO | onb 99 
B Suopusye snou snou ‘‘p oddeis ey red sagumutou "7 suep 
souuosiod ap oiquiou 9] ‘(,,2 op juowoyedioutd puodap 
(yn? Sp UOHeUINSA | onbsing *'u ddAR UONLIAI 9p o1Udd 99 
sed ajnysod ou ya mod onbyayjodAy stqeasueyoe syopour 
g] aonb suojoNn “uw ke youuonsodoid juswoAneuttxoidde 
yso sogumuuoU souuosiod op oiquiou oa, “uonbgsuod sed 
‘nb yo = ((‘w*g—)dxoa — [)°1 + ((‘u'g—)dxa— 1) (‘mu — '1) 
souviodsa, | 3so ‘fp oddeis vy sed sooumuou souuossod 
op ciquiou a] onb onbrydumt ajapou 99 ‘aId0sse moajoepel 


900Z aiqwss—ap ‘ajenbus,p senbiuyos | 


un 9USTINOS eB] SWWIOD ‘(SopoyjoU sod op uONdLIOsop 
aun mod jomideys ‘796, J0G9g MOA) poyyo-sostid 
SopoyIU Sa] SUBP 9SI]IIN o[Qpour uN ys9 (,,.d Say JoIpUIS 
mod 9Xojdue sjgpour 9T *(900‘0 100) © ((2)2 “(yZ) 
® (€0'0‘S0'0) © (ZZ) -AL 1 Tp suonefndod 
So] aa (Z00‘0 ‘10‘0) © (2 “(yZ)  ~=(10‘0 ‘S0‘0) 
= ((d Fy :]] 30 ysuoneindod say mog ‘sonusjgo 
woos N/ (yd yX= yd ep soyueams smoyea sot onb 
uodsey op sooxy juoreja "J op smoyea soy no ‘(‘wu*g—)dxo 
-|= ait pepo g] juesTyN usa sooisuss 99 UO 
i eSNG = ‘Qe uoleUIWOU op soyyIqeqoid saq 
‘OANLSOU JTLMUOUIG IO] 9UN.p essise.s [I oyNe.] suep onb 
sIpuv} ‘UOSSIOg Op Io] oun jI1e}9 ‘Py Sop IO] eI ‘outed onbeyo 
op suojeindod sap oun,] suep ‘onb yey 9] Jnes ‘sopqeiquuos 
yo} yuorej}9 omed onbeyds op suoyendod say ‘uonendod 
PR] Op %OL wUoMAUS jeIAnod ajo ‘AT 30 [I] SUonendod 
so] Jed sousioy omed vy suep onb sipue) ‘uonendod ey op 
% Cp UOIIAUD JICIANOD BSEpUOS ap oseq YI ‘TI 39 | SUOTJe[Ndod 
so] Jed oouoy omed ei sueq ‘“[ neojqe) ne ounoeyo 
sqoep ‘suonejndod anenb dsIspisuod suOAe snoN 


[ABD ajUOA] ep apnjygq *s 


(YHAT+CTVA 
=(1)A S90 2 Op soUuRLIeA eI Op ImoyeuNsd uN .nb 
ymsuo,s T ‘Ox(2‘z)aop onb onbydun “we e yoddes 
red ( “w| 2) aq ap 2ouepuadap-uou ev, onbsind ‘uyuq 


[=! 
; d/l w& (ou rH 4) 4 fg 

1 Rape Z @ F 
(od / od 5 Ree ne 4) 4 


i) 
Teere rz, "\( kes 
wigan ‘to+( Dod = ag 
Y% t-weer ios 
1 4 (Z) 
‘ —————+%)- 7 aa 
I ] is iz@) x ‘ 
(@¢-D “IL = G w 
id ADE Pema 
Pg dl roe 
G 
(4=%) 


(Ol) C6-pO2* 


1 1 wd = 
(od a Did | ‘q- z| « 
ge 


ondoyeyeo nv Gq@X-100-ZI .N ‘epeurD onbysyeis 


yso (°2)A Op INoyeUNT}sO UN ae 491 =(" w| %y ()Z)AOD 
sia ‘uog “9 ~[( “u|°2) al7A onb juowurenbesuos 
y “ur op sed Soma ou AG “un|*x)? q  onb jymsua.s 
E (4-D=G wo (GO-1%)ug~ “wy 
~ (4 *2)uIq ~ ‘a ,Z onbsind ‘“2 ap seo 9] sueq 
Ta + "a =('2)4 380 ('2)A op o8epuos 
op uvjd oy Ins spuoy adh} ap moyeurnso un ‘juonbgsuood Jeg 


|=! 
; F/I cae 7 OU ‘en 4) € abit od 
1 Uy Tt I I ibs 
wd! me Dede uC. Ss A), Hs 


no 
i = Y-w—'y 
ld ()¢ é VER 
oa ge wd | < Olu — '2)¢ 
(u—u—'2) 
‘ z y ae tg 
(6) (6 -)'G(u a 1) ‘i 7 A 


(DY u 


a wf \5 
(yd —Dpd(4— '¥) 2 q- z| Re 
pNeah 


ete [(°um|'2) 7a] a op ImoyeUIso 
un “\d'G(w— '2) = (uly “,7)A0 onbsind ‘ano ug 


(g) of /I pega /ou — 4) +1 fe 
[og ad WK u |( (low a) : 
yo 
MTSE Ot Co oD PCH — Wa 
FORTH Sala oh wd oo 
I I X eltcn Nocan wi 
Coe 


|=! 


(Z) ‘ (w— 'w) KC ylwse-pe="p 


s =) d 

yso [Cul '2) “aA Op 
Iayeuyso uN.nb suoae snou “(, \d Sy ao 00 Heo 
—| ‘w —'1)urq ~ *“w|'y 49 (( 4 “ul — '1)utg ~ “wi ,..Z onb 

JeJ I] Jo JOUIAMALIOJUe oILIOAp sISoyV.Ns v] JURSITQN u_ 
T1=¥ 

< u oe al! Ss (hE Cees ibe s4 I 
COSY Aleta 6920 ia) Aim A ae le lk 
‘ZWD = (2 8P 2Qpour 9] Ins sagpuoy saourgdso sop 
moyne uowaanoadsar “2 yo '2 ap “2 Jo '2 oupsO Jomuold 


seddei6 ua je sual| ap ebeysidap sed eHheuuo||!}UeYOS,| ap UOSIEUIQUUOD : UIpPsefUO/\ Je eUIPS/\\-xI|94 rd Ws 


ansojejeo ne Gq@X-[00-ZI oN ‘epeueD onbnsneisg 


ap JojAe], op UoNeutxoidde xne (9) yuenbrydde us soueLiea 
ap sinoyeultjsd say suoua}go snou ‘oUDGq ‘asepUOS op 
uvyd 9] Ins sagpuoj douRLIvA ap jo douvIodsa.p sinayetodo soy 
quajousp (-)“A 10 (-)“q 19 {w= “Ww onb JUeYoRs “oyepou 
J] INS Sdgpuoy So[JoUUONIPUOD doUeLIeA Op 30 ddURIOdSO.p 
smayeiodo soy yuajousp (*ul’2)?74 30 (*uml*2)?q no 


(9) “[Cul"2)*a)a + (Cum|"2)?a“A = C2)A 
: |NUAIOJ VT VIS mod suosiyN snoN “°¢ [ey UOTTHULYDS | 
Jouuoljoojas nod gsijyn oseuuoTHUeYOS p ued np a]I0 
Jed soddeis op sayjie} sop UoNNQsSIp e] Joov,dulos eB aysISUOD 
19-2119 “(h00Z) YosdwoYy], 19 eUIpPe|\-XI]9q Jed sestpN 
a]Joo onb o1s9ye.s SUIOU BI JURAINS Ud dsEpUOS op uURyd ZT 
Ins gpuoy 9d4} Op SOURLILA LT OP SIMd}VUUISS Sop JOALIEp Jed 
SUOSUSTUTUIOD SnoU “‘dT[PAIOIUT.P dIUIS 99 sIIN.YSUOD INOg 
“Ty op soueLIeA 
B] Op asepuos op urd oy ms gpuoy odAy op mayeurNse 
un jso (72)A 0 ‘piepue}s o][eULIOU IO] ke] Op -Imatodns 
Z/7 yulod 3] 1S9 PS Zen sat fos 17 Eee oU ty 
B] Op osepuos op urd 9] Ms gpuoj adh op %(0-])00I 
PIeA op soURyYUOS sp soyeAloUI sop uonendod 
ap soyie} soy Inod suosinysuod snou ‘ouoqd ‘sinayeuNss 
Sap SIO] Sop syqvuuostes UOeUITxoIdde oun jsd O[eUIOU 10] 
ev] onb suosasoddns snou ‘oyeutiou to] oun yuowonbyoj;durAse 
yuoAIns uoHeindod ap sare, sap sasodoid simoyewnsd soy 
onb ror yuauranbrosy) sed suoLjuouwsp ou snou onb usalg 


PIZAA OP VdDULTUOD Op SaT[eAtoUy «Zp 


"SINDJVUINSS SIO op SINITeA JF OP SaTQUIOSUD sap UOT[HULYDE ,-p 
SOOULLIVA SO] JURTNITeS Ud SaTduUIs SUOTeUIT}SS Sap ITUd}Q0 .P 
gjqissod jso I ‘2 yo °2‘'2 op saouelieA sap dens}ooq 
SUONLUTSS So] JoyNoyeo yuouayes9 oyeyNos UO] IS 
a W 
sop onbyoyjodAy 107 ey e@ Vodder sed syreo9 xne soysngol 
JUOS sjUR}NSOI sOURTUOD op soayyeAroyuT soy onb Joop 
-ISUOd suOANOd snou ‘suo ‘soddeis op jen UOTTWURYDE | 
JouuoTsaas Imod gssijyn oseuUOT[HUeYDE,p ued oJ ms 
seu “yy sop onbyayjodAy uossiog op 10] e] op uonesTNN, | 
Ins sed ssodar su deys}oog np syueLteA 93390 anb suojON 
‘2 Op 2 oyeUISIIO UOneU 
-]S0,| op dens}oog uoNNqmysIp ve] op motiedns jo morioyul 
¢/ syutod sa] jUOs (o-py ? (wnyy NO Lent “(wot 
Jso_ [I ‘soywuso sap spoyipur eT suep yo ‘[(,,,)4-22Z 
‘(gn-pr— 47] 39 2 Mod o[eAsojUl.| ‘aseq op spoyjow 
BR] sued ‘(sopoyjsu soo op uoNduosap ey mod ¢ anideyo 
‘L661 AOP[UIH 19 UOSTARC] JOA) saytyUa. sap a]ja0 no aseq 
op spoyjour ve] JUSTIN Ud 2 Jo “2 ‘'12 Mod % (0—])QOI 
dejs}oog s0URIJUOS Op Sd][eAIOJUT soy omMsUOD (IA) ‘2 
Jo ‘1 ‘'2 op smojea g Op Sajquiasus sop Imsed e sonbinduwes 
SIO] Soy] JUR[NI[eD Ud jo SIOJ Op g dIqUIOU pUeIs UN (AT) 
B (1) sadeja soy] yurjodar ud 2 yo “2 ‘'2 op deysjooq sio] soy 
TU9}GQ (A) “2 38 °2‘'2 SoTPUISLIO SUOTJBUSA Sa] JoTNOTeO 


LL? 


Inod sgsi{yn s[90 onb spoy}owW WOU eT JUPAS UO (IIT) 
39 (11) sadeja xne soit} suoT]WUeYOS sop Imied e 1 yo 61 ‘'2 ap 

; fi 
Ce So] JofMOTeD (AT “SOOLMROIPUT SaTgeLIeA op { (-\X} 
}9 {()X} Sa|quiosue sap sINaTeA saj JUOTNUIIS suOT[HULYDE 
sag Bowes 9AJasgo UoTHURYOI | Side .p sogmnojeo (,.d 
te) ye ‘C1 “Ty ap suOTyeUTSO soy JOS 


1 TGC a Cl 
; ; we P wd “yd 
no YuowdAnsedsal ‘od  «) 


d souusXoul op I[noulog 
ap sto] sop med ev % jo ‘w—'z sol[re) op suoj[yueys9 
sop Jom “7‘*"*2=2 onbeyos mog (mM) ‘uoTTWURYDE] 
suep ‘Ww sop saoiput say “2‘*"* ‘2 ylog * ‘uw sop uonendod 
e] op med e soyiey u op YSSVA UN soUUONeI9g (TI 
‘oddeis op sayiey uw ap dsArasgo uolHUeYd9,] op med 
B soguUOTOeTES ‘Ww sap SINTRA 4 OP CYSSWA) SSIWaI sues 
oduris onoyesye uoTTHURYSE UN ‘wu SaT]Ie} Op d[QUIDSUD 490 & 
Jomnofe yo oddeis ap sayjie} u ap SUUONDIIIS UOT[HULYII | SIOJ 
y juejodo1 ud uoTyendod vy] oMysuUOd ‘syHIsod soyUS sop 
yuos 439 ¥NO “4+U¥=N IS “Us “we oddesd op saryie} 
U dp QUUOTDIIIS UOTT[MURYD | “JoUS sIqUIOU UN 4so U/ 
onb juesoddns us ‘sioy u/ Ay yuejodor ua ‘ww sop smojeA 
N op oyoroynse uonepndod sun oimysuod (1) ‘sayueAtns 
Sg] JOS suosodoid snou onb spoyjsul ve] ap sodeyo sa] 
(Z onideyo “L661 
Adpurp 30 UosTARq] JOA) deys}ooq np onbiysuresed oyueLeA 
PR] 1° (661) TPH 1 Lopng Woog sed sgsodoid somy 
suorejndod soy mod densjoog np ayuelea ev] yUeUTqUIOD 
ud onuajgo deys}oog np UOISIOA oUN SUOJOSTTVN snoN 


dv.ns}00q ddUvIUOD ap SaTVAAIUY oO "p 


‘(9]U9991 
snd ey] o1sojouru4a} el Inod 966| UdLIG.¢C 10 Wry ‘sueAq 
yo ¢] osed ‘7EQNT Ysosy MOA) sfeuLIoU uONneUTxXoIdde 
oun Ins sgseq pleA\ op Ssay[eAlojul sap 30 densj}ooq 
SO][PAIOJUI Sop suorouTUIexs snON “Wy sop onbysyjodAy 
uossiog op 10] ve] e& wodder sed syieod xne soaysnqol 
yuos nb osepuos op uryd 3] ms spuoy dA} op soURI~UOD 
op so[eAIoUI sop smuajqo mod asnuonbay sysoidde | 
suOJOSI[N snou ney snd onbrpur suoav,] snou swiuwW0D 


uonendod ap soyjte} soy 
Inod sdUvIyUOD op SaTVAAIUT “Pp 


“i ond e ouudAoul e] SIDA (0 Op Joo ‘one | 
J (28 onbyouiyjie ouussowl ke] SIOA (,,0 Op MyI0 jUR}P 
UN J ‘JUSWASSIO9.NDI Op SOUIo} sap Jed AMS (,.d op AWALL 
Op SWOJ [TB (7 mojeUINSO,| “MoyeuTLUXS UN JonbeUIOI 
We} B] SWILUIO ‘ayo UG *Z‘T=Y¥ ‘us T=1%,\0 J “2 Op 
yolns ne oyenul UONeULIOJUT,] sssodoid sinoyeuyss soy suep 
SOIT OUT 3S9 Nb a0 ap “(pOOZ) UosduoY_], 39 eUTPOP-XI]9J 
red sogsodoid AIY.] Op Sowliof sap syuouajsnfe sop 
JUOWUI[LJUSUULPUOJ JUOS SIMND}CUITSD Sd9d OP SOULIOJ so] 
peers ealshegek 4 ago l ge) 9) 
moyeurysa un.nb ymsus,s [[ *Z T= ¥‘U/ yOu = (PD NO 


900Z eiqwssep ‘ajanbue,p sanbiuyos | 


Calry 
(s) Eee SS oe Dua 
nA — (70 
70°4 fy y { (cj Of Ax +1 nich 
Pe Ty: 
()2- (ZP? (QZ { (2) BF dxe ; 
(g@-D | LCa+D-1 
(37 -D "| [tCa+p/-%) + 
law — 'y)u 
Oy Coeoe & = 1 ¢ =. 
(r) hip fate, 
ToCW—"2) ‘W's {po} dxo +1 
a ae ie Tes ear a OO oe )¢ 
eS MZ {(yojdxe  “ 


[ee 


(y¢-D Lica +N)/NIN/Y-D=1 
=i 7 ‘2 


(¢- D LICCa+ any G- nln e D+ Y+W 


¢ 


: suonenbs .p auia}sAs 
np uonnjos ey 3so gsodoid mojyewmss. onb suoae snou 
‘s1soyens ayoo yueydope uq *( “9 ‘0 “2 ‘'1) op moyeunse 
sumtui0d »= (saguuop|“0 ‘0 “2 ‘'1)u ap opoul oy suoJOsTTyN 
snou ‘([86]) Ssulpepsed suep oumtuoo ‘sieu ‘1 40 
'y 9p WoLa\sod v sto] soy Inod suotssoidxe soy ITUa}gGo ._p sed 
suojoAesso U snou ‘ (2)? B30 | 52 e yoddes sed (¢) op onby 
-Ajeue o[eIsoUI | Jopnoyeo eed shots au snou onbsing 

7 T= yUu/jo+ Th= "a yo 5.10 sop onbnourmjie 
ouUdAOU BI 4S9 (2 oy ibd weie yuos nb ‘°s—'n 
suep no °s suep yios ‘'Q suep sojoulsip souuossod 
ap siquiou 9} onbipur nb |, 7+ ()Z = 0% ee 


Q[UHRA L] OP SP9AJOSO IMS[RA VI 4SO 2 oa ae = (2 no 
Caz 
cf pthc (2) AL (0 }dxo ar 1| I=! 
(€) doe ee eel 
£97 Ro qh ]dxe : 
aT 
(22 (Z) 0) 7k 
AZ 7 
ee 
(r+ (ui %) gr 
dxa x 


lo ey 
( )I OE ¥ 
1 [= 
(2 v (y?) ne | 


vanLE@Pldxe +1] rig wyi(u a —'2) 


‘70|dxo 7 (o+')7,(U-N) ox 


Li? (1) 


(saguuop| ©10 ‘0 “2 “!2) 


angojeyeo ne qqX-100-Z1 .N ‘epeueg onbnsneyg 


IUIO} RP] Snos souutIdxa 

ano yned “0 30 "0 ‘1 ‘'2 op LOLIa\sod k ayuIOfUOD IO] BT 
‘(Z) suep 
SINITeA $90 JOsT[IWN suOANOd snou ‘sm9}eUss sop UONPALIOP 
eR] Inod ‘stojaynoy ‘"g yo “D ap smayea sao mod sruyep sed 
yso.U eUTUTeD IO] eT oOnb suOo}ON ‘JouTaAToodsa1 ‘7 ‘[ = y¥ 
(a Gal =e Cale eet ey (ee = Dont mreodans 
ud snuajqo (Z) ap SOJT] sed sop JOS SOLIOJIUN SIO] soy 
jo SAOYJOL Op SIO] SOT ‘eUTLeD UOTOUOJ eI dJOUNP (-),J NO 


2) ig a Ce 
‘ PRC ot So) 


G+N j' 
clung Obl Pab 2) J a 
: SOATIESOU 


SO[PILUOUT SIO] SO] JOS ‘eLUTeD)-UOSSIOg Op SIO] Sop med & 
sonuajgo ‘°2 yo '2 op ond & soyeursreu sto] soy onb sored 
‘QUIIOJIUN dISTUL Op sogzeN ang yuoAnad sayfa ‘62 yo '2 
mod word ve to] ap sodAq sto ruyap suode snou onb usrg 
‘syuepuodaput JUSUAT [ON NUT JOS 
cep (ype ko) = Me no '(4g tm). 19" (7442) 
SOMOJY]C SINDJOIA Sd] sno} onb suosasoddns snou ‘uyuq 
ZT T=40= 3A yo “= "9 quexy vo (1) 
op 1s B oisop UN & [eUWJOU sTEpoU UN IUA}Qo suoTLMod 
snou * aie so] mod sayuevpusdsput old vB SIO] Sop SUOTTNOA 
SOU IS JUSWOT[OINNVN *(,,0 sap jonboy oyodurt.u ms syusw 
-OUSTOSUdI Sop ImU9}GgoO Inod sgsIyWN ysa xno aQUd,p jonboy 
syodu.u op jofns ne uoneWuojul., seu ‘syuepuodaput 
sed JUOS OU (0 So] “SII[IquasuLYoS .p ssatjodAy | snog °"9 
juRYoRS sJULpUddgpul JUOWO[OUUONIPUOD JOS (,,10 So] 30 
‘sonUUOD SayUe}SUOD sap yUOS ah yo 7 Le ‘70 QOURLIBA Op 
yo "9 ouUdAOW ap oyeULIOU IO] eT aUaSoId9I (Jo ‘t9) A nO 


T=rCA CNN ~ "6 


(Ayu 
70 


(‘2)u 


(1) Vey tae Op 
10 


(29 "ON ~ "li? 

seed sop [Coy iach d|80] = 2 SISO] Soy Inod saidop 
xnop & [CULIOU dTOPOU! ds] SUOJAST{IIN snouU 39 solqeasueYyos 
JUOS SoTjo,nb suosoddns snou “([36]) SUIPspiseD op IeISUT 

B ‘,d uoneurUoU ap soy[iqeqoid sop seo 9] sueq 
"SOATLULIOFUI Sed yUOS OU Sed sane 
xnop So] SUP SOIUTJap SIO] soy ‘soe Jeg “UOTTMULYSS | 
op uOor}eAIasgo,| JURAe onuuUOD 3yso Inb ‘1 yo '2 Op 
yofns ne UONPULIOJUL,| JosIpIN,p smoyosoyo xne jourlod seo 
90 onb suoustjnog “'y suudAoU op UOssIog op 9]qeLIeA oun 
yso ‘wy onbjo ‘'yy .'<% = '2 onb wey 9] UoNeANou! mod v seo 

Jomuoid 3] suep stuyjap '1 op uossiog op woud e 10] ey] 
‘soquepuodapul somoyesye 

sajqeuiea sop yuos %2 yo '2 yo ‘7‘T=y¥ NO Jw»(72)u 


SOUWIIOJIUN SIOT 


seddei6 ua 19 sual) ap ebejsidep sed eHeuuojiyUeyoS,| 9P UOSIEUIqWODN : UlpJefUO|\ }e eUIpey\-x!I|e4 OLZ 


ansojeyeo ne Gq@X-[00-ZI oN ‘epeueo onbiysiye1Sg 


‘soyuepusdopul somoyegye 
soyqeliea sap quos %1 39 '2 yo ‘7 ‘T= y¥ NO “71/2 (72) 


SAITJIL IP SIO'T 


‘syuepuodopur quos (“y *°2) 
9 ('y‘'2) 39 ‘sanuuod sayuRysuod sop yuos “gq ‘ny ‘'9‘'o no 
‘ c (€ ONG & Try| C 
ty7g-? 1% V 20 ( Yu jo | 1/ nV, ® ( v| 1)u 
ryg-2-wV¥ % (Y)u 99 5 '2/ CN) 2 CY !2) 
BUIUIE)-UOSSIOg 9p SIO'T 


: Word & SIO] Soy mod yusAns 
Inb sojapour sio. sd] sUOJoJgpIsuod snou ‘2 yo '2 op 
seo of sueq ““d yo 'd ‘°2 ‘'2 op Lond ® sio] sop UONTUYSp P| 
ap sulatqoid 9] Ins Joyoued snou juRUDyUTeU SUOTTe SNON 
‘°c suep sastiduros soddei3 
sop oun surour ne sed sagumumou yJuos Inb “uowdAnoadsal 
“wy yo Q*°s—'Q suep sojounsip souuosied ap siquiou 
a] quonbipur inb ‘y yo “y ‘'y somoyegye sofqeiiea sop 
SO9AIOSQO SIMBA So] WOSs 4 CK = "Mm yo Hd OOK 
id it oo" = yo Sp sed sogumuou yuos inb 4uouw 
-sanoodsar ‘“79 30 °S —'Q‘°G suep ae souuosiod 
ap siquou 9] juonbiput nb 7 3 @_p)Z “)Z Souoyegye 
SI[QLLIVA SOP SAdAJOSQO SINITeA Soy JOS of Da ak tes oz i) 
a ne a KGa et 4 : wy pa EG We =" (9)? ‘yuowoAnjoodsal 
sp yo “QA °s—'Q suep sasumoU souuosied op 
s}UoWd1quiousp xne yUspuodsaio< Inb ‘A op sted eB snua}qo 
SJUDWISIQUIOUSp ap Satquiasua say jos ‘°s dD 'p one A} 
od = yA ie oe ae > EO es D RE (0-1) Ass aad 
souuosiod ap ciquiou a] onbipur mb py omoyesye s[qeiea 
RB] Op s9aJosqo Iofea ey yso ‘wu I< =i ){'w}= "ui no 


' Vesey 
¢ 'd 4 eos —— i: 
bebalio? & 1) iL 


— Y¢ 


(Fda ur] A) f 


Ni wl yt (1) =1)x 


(0) 


‘ oO” OQFO a 
apo ee ul) 


Zl ll Cd ur] hy MS 


re ce 
i or OFO 
nk ai yt Litt ae '1) 
co? j(w—'2) 


u 


= (id un | pF 


‘Ti@- 


1 ER Re Ee ag ee 


: SJULAINS S:INBJORJ 
I 1 2 Teh Geared 

wpa ez d 11 
uoyouoy =e onb- § sJaQUOW 


sap ympoid of ys H{.d}= “dy 
op dsoUuvlquiasIelIA ap 


602 


Inod (g¢6[) yooueq Jed sgstjyn spoyjsu oun onbriydde yuo 
 “(N/U-L‘SN/LSN/T) 3° '2 Jos sanourered say JUOp 
gyeruounnur to] oun yso ‘'1 = ‘w '<% onb yueyoes “(‘yy IX 
“ars ‘Yar) op aqutofuos ayjauuonipuod 10] Pe] 
onb yey OT VSITHN WO (PpOOZ) UosduIOY,], 39 PUIPS|I-XI[9J 
Cer = Oe a ee Ht ‘@)d suusA0ul 
P wy “y  soquepuodapur yInouae ed op somoyeg[e solqeiuea 
ap suonesiesr sop yuos _ a SOTQvLIeA i ‘j@ xnenb 
sure ‘2 yo '2 e& *°s suep soddeis sop “w‘:-*‘'w sayyrey 
xne yuoWoTJoUUONIpuos ‘anb suosoddns snou ‘ayno uq 
‘uoHeUIUOU op sgqItiqeqoid sagjedde juos , ya soiqeqoid 
soy -°s Sp JuouoRdura | red ssuruOU jIos ‘Y — 779 suep 
astiduios suuosied oun nb FUR RI] yd ted suojougp 
snoN ‘'y ouuckou op “py ‘**:‘'yy soyuepuodgpul uossiog 
ap somoyegye so[qelieA op suonesieol sop yuos “p ‘**:‘'y 
soddeis sop “w‘'‘tu sare, say onb suosoddns 
snou “(p00Z) UosdwoYy] Jo eUIPS[-xXI]2J4 OP IeIsUL] VW 
‘uonendod ap sayjie} sop Lord e SIO] 
Sd] mod sajapour sureyiso onb Isure “UoTyeUTWOU op soyTTIG 
-eqold sap sjido] sap Loud ke sIoy soy mod (136) SUIpspsed 
Jed uoneispisuod ud sud osjapoul un suosi{yn snou 
‘apnya ojuasoid ey sueq ‘WYOd,| ep quustsaXeq sasdyeue 
sop onadsl oun mod (666]) JoyxUNe 39 UOSUYOL “SIOqUdT] OA, 
WUOd.] op esdyeue.| mod sasodoid 339 yuo mb suatsaheq 
SoJapour sop suIeyIad sed onou ke Jonbiydde.p younod 
snou Pag (WYO) ednynur omdesos-omjdeo sed oseu 
-UOT]HURYDS,| Op INjoo Jo dsevUUOT[HULYDE p uLd mo, oqUA 
QOUL]QUIDSSAI BI 9}eJSUOS UO UOSdWIOY TL, 19 CUIPSIA\[-XI[9] 


1101.19}S0d & SIPOUI So] 
Ins sgseq uoyendod ap say} sop sinayeuysy *¢ 


‘yuouionbrun *p yo “4p ‘’p red sagumtuou yUOS 
inb Q suep souuosiod ap siquiou 9] yresos “A ‘{g ‘7 ‘p} =O 
Is ‘ojduoxo seg wou yuoWONNe sieul ‘MO ds[qQuIdSUd,] 
suep stiduios 3so 7 oyjonbey mod ‘p sguuoyHueyse oddess 
onbeyo sed sagumtuou yuos nb 7 suep souuosied op siquiou 
oT Subipumia FO ei th Oa NO een 
SJUSUIDIQUIOUSp sap s[quiasua| IMs sogseq Juos ‘1 jo 
'y op yofns ne saousrgyur so] uonbgsuos seg ‘sagyonbya sed 
qUOS dU souUOsiad soy] Jed ‘soUUOJOD sme] op suoNneynuod 
xne nbsnf onb sonuuoo yuos ou ‘x yo ‘x ‘“(p00Z) 
uosdwioy |, i BUIPS|-XI]9J oUSTTNOS UO] sUTWIOD He 
-onne ~= ote 10 oddeis ey red sgumutou sa 673! ‘n 
ue pe eis Ls ie ‘quigui oq “‘p red sourumou sed jso U 

‘nno p> i ish. Qs an yo ‘“'p oddeis ey red soumwou 
4So Lis Wg Pe ‘n guuosiod x] Is l= ¢ os no Scr fae] ait 

i) be x]='x soomeur sop ee ne Se 
vias soddeis soy sed souuosiod op uoneunuou ey 

‘SUTUUIOU SUS Jad BT OP MOTAIOJUT 

oun juvinp ‘ayqissoduit yso vj9d IS ‘NO UOHeUTWIOU Pv] eT 

e mb ouuosiod ve] op soudne nuajqgo ang ynod UONeUIOJUI.p 


900Z aiquesd~ap ‘a}anbue.p senbiuyos | 


JUDUID[D JOTUIOp 9d onb sJoUsTTNOS op yUOTAUOD T] ‘JUoHITedde 
[Jo jonbne uonejndod ey ap ‘7 no '7Q JUaUIBes 9] onb Isure 
‘suUOU yUO | Inb syusudSR[dWID soy NO 9s] JoNsIsoIUS j1Op 
Ioyosoyo sj ‘aouruoU suUOSIod onbeys mod ‘uyuYq “yuour 
-ored9s suoneunuou sop omey yeumod soiquiour ‘iw sop 
unoeyo “yy ‘quowlsoe[duis one un suep onb sipury ‘adnois 
onb jue} uo ‘sorquiout ‘Ww soy Jed soyey ong yuoretmod 
suoyeuruou soy “Pp yUouoorjdu | e ‘ojduioxe eg ‘syuoU 
-ov[dius syusIayjIp e sogsT{yN ong JUdAned uOTeUTWIOU op 
SOISQ]C.S SISIOAIP JO ‘sayNe sap souN soy JUoWTUTepUsdopuT 
soyey yuos soddeid sosioAip sop insed e suoneuruou 
saT ‘oddeis ay399 op oiquiow uN suToU ne red sguTUOU }s9 
aq] Is oddeis oun sed soumuuoU 4s9 suUOSJod oun nb suomp 
snou ‘uoludsAU0d Jeg “°s 5 'p oddeis onbeyo mod agjeda1 
yso ompsooid ay0d ‘UoNeIspisuod ua sosud yuos ‘p- 7 
suep sastidtuos saaumuuou souuosied say saynas steur ‘9 op 
SOIQUIOU sap JouNUOU ap ‘f sguUOT]TWUeYDE odde1d vy] suep 
sosuduios souuosiod xne opuerulap uo ‘sing ‘UOTTWURYO9 | 
suep sonuajuos soddeis soy] yuoWoessao9u yUOS oSepuOoS 
ap oseq ev] suep soddeis soromuaid u soy onb sed oyrusis 
dU P90 ‘stoJaqno} £°s' suep soddeis say Jo}ougp nod u ‘*** ‘J 
SOOIPUL Soy 9SI]N sUOAR snou onb sUodJON ‘sddTFWUSpI 
yuos °s > 'p onbeyo e juouuonsedde mb souuosied ‘uw soy 
30 ‘OSTUOI Sues O[dUTIS aTIOJegTe OSvUUOT[HULYIE Jed asepuUOS 
op oseq e] op anied & 911) 1s0 soddes3 uap {“p‘' ‘ py} = °¢ 
uOT[HURYOS UP, ‘JURAINS Z| 3S OSeUUOTTHULYDE .p uRId a] 
‘oyyiey es '1 -1 = “2 los Jo osepuOS 
ap oseq ev] Jed oyJ0AN00 uou F7 op onsed e] 'Q-— Q= “7 Ios 
uyuq ‘w I<='2 sioje ‘a ‘‘T=2p~ e quouuonredde 
Inb souuosied op oiquiou 9] ‘Wu yo BBepuUOS op oseq ke] SULP 
oddeis no yuowrsor[duis 7 9] ‘vy Wog uowede]dure [nos un 
enb juonredde u odepuos op aseq ev] suep Juvmsty suUOSIod 
oun nb ssoddns uo ‘omeurpsio soddeis ua oseuuo]yueyos | 
suep oumtos ‘anb 39 (QQ op ayediounid onsed ey aquosoidas 
asepuos op aseq ej Jed yoanoo 'fQ a] quiasud-snos 9] anb 
sed osoddns ou uo J aonb suoustnog ‘yuaurtaoe]dud 499 JonjIs 
op “OAnPeULIJe | Suep 4o odepUOS Op aseq YI SULP JURINSY 
quowsovjduia un e uou no jJuanredde suuosiod oun Is 
JOUTULIN}Op op joutJod ny nb ayjouuonesedo ajso1 oun 1WqQRI9 
B Iayosayd a] onb jo syuousoR[dula soo ap AY op osepuos 
op oseq oun oMNsUOD op aiqissod jso0 [I,nb sasayjodAy 
soy Ins omndde.s sseuuo][Hueyse,p uejd 99 ‘suoneyqey.p 
SJO]I Sop no sored sap ‘seq Sop SUILUOD ‘saTqIssao0~e S}UDU 
-sov[duio syussayjip suep Joano.y ynod uo, onb souuosiod 
op '2 nuuooul siquiou un Jed WLIO} ap s][qQuIOSUd-snos 
un '7 Og ‘2 sNUUODUT aIIIe} Op soyoRd ouTeUINY UoT}e[ndod 
oun {*n‘:*'‘'n}= Q Mog ‘uonduOsep dAdiq oun IDIOA UY 
‘(pOOZ) Uosduoy, 19 eUIPsy-xI[91 Jed sasodoid xnoo onb 
SOUIOUT SOT JOS poe JUSSoId a] SUBP SUOJEPISUOD snouU onb 
aseuUo]]HUeYDE .p uryd 9] 30 UONRINdod x] op oMjoNs eT 


UONLIOU 39 BSVUUOT[HULYII,p UL[q °Z 


andojeyeo ne FdX-100-Z1 oN “epeury onbysneig 


‘« QUUDISSARq OpoyoU 
RI Jed agisisse » 1Sso a]JanuosgyuI ayooidde 9y399 aonb suosip 
SnON ‘uxd of ns gpuocy odAj op densjoog souerlyuos op 
SOT[eAJOJUT Sop SUOSIN.ASUOD snouU ‘anno U_ “eISpP spoyyoU 
eR] Jed snusygo urd 3] ms spuoy ody op souRLIeA Op smo}eUl 
-]SO Sop SUOST[NN 39 S[eULIOU IO] BI INS soseq soURI;UOD 
OP SOT[PAIOUL sop sIIMSUOD ap onA Ud (p00Z) UOsdwOY], 
yo PUIPEY-xXI[94 Jed sgsodoid oisoyens ey vod mod 
suo}dope snoN ‘s0URTFUOS Op Sd|[PAJOJUI sop suOsIN.QSUOD 
snou ‘sfonjouod smoyewiyss sap Jopnoyeo ap snyd us ‘ouog 
‘aysqquonbay ayooidde oun uUojas SaoUdJAFUI Sd] SUOSTR] snou 
stew ‘uonendod ap sayjie} sap sinoyeujsa sop UoKoN.jsUOD 
RY Joyploey nod suuatsoXeq spoujoUr ev] SUOSTTN snow ‘Toy 
‘uorejndod 
op sonowresed sap jolns ne someyuourstddns syuowsus1esud1 
Sop SgidoyuI yUOS sjonbsoy suep smojeUIT}sd sop o1mM.QsUuod 
mod suustsskeq oyooidde | oJAIs e& a\SISUOD sWaTGoId 
99 B JONJUDAD Opodo UN ‘xnd VOTES ‘UOHeuMUOU op soz] 
-Iqeqoid sap sayqeis suOeUIsd sop Iua}qo mod ayuesyyns 
sed jso.u mb gyuUenb ‘uoT[HURYDE,| JUONUOD onb uoneW 
-Jojul.p gnuenb anod vy e np 3So sorqiey yUOS UOneUTUOU 
ap soyyiqeqoid say onbsJo] aysoyrueur os mb uoneurmnsoims 
BR] op owigqoid oa] ‘smoyne soo onbrpul yuo, owu0D 
Se[qhey 
yUOS UONeUTUOU ap sayTTIqeqgo.d sa] Is UoNe[Ndod ap aqjIe} ey 
JUSWIDARIS JOUINSOINS B dOUPUd} JUO A JA Soy onb sayeysuoo 
qUO S|I ‘ONO U_ ‘soysngol sed yUOS OU sTa=pOW UN INS sapuoy 
OURLIVA Op SINd}eUT}Sa say onb stew ‘anbyayjodAy sjopour 
ne yoddei red syred9 xne saysnqol qos urd 9] Ins spuoj ody 
Op SoURLIvA Op SMayeUITSS sd] 39 UOnLINdod ap saj[rei sap 
AWZ® Sey enb sxyuour yuo sIMayne soy UoNeTNuUIs red opnje 
oun & SORIH “IMd}CUINSd.p dJUAS 90 ve SOUDIOJOI OMe] nod 
« uejd a] Ins spuoy odA} op» IMo}eUISd,p suOJoyIed snou 
‘QpoIIe | op Buoy ne ynoy ‘sonbysyjodAy sopspour soy ms 49 
[eHIUI UOT[HULYDE | JoUUOT}DaT9S Inod gsi[Wn osepuos op uRTd 
OQ] INS SIOJ LT & SOPUOF sMd}eUITSd sop dIIP-k-}S9 0 ‘osepUOS 
op urd 9] IMs sspuoj yUoWOT[oNIed jo sTOpou UN IMs sopuoj 
OULLIVA SP SIND}CUIT|SS sap Issne yussodo.d s|] ‘uoKeUuTWOU 
op si]Iqeqoid op wou a] SUUOp UO aTfonbry] ev GuoWoR[durs 
un e gumuoU wos UoNnendod ev op siquiow un .nb 
aytqeqoid vy onb isure ‘UoudoR{dtus onbeys ve syaAnos9p 
SJUSUIDTO,P SIQUIOU sg] JWOALIDEp Inb saystjiqeqoid soyepou 
op imsed e uonendod op sajiey sop (AJA) 90UR[QUIOSTeIA 
op WINUITXeU Np sIMoyPUIT]Sd Sap SALIOp UO sIMone sad 
‘uoneindod vy] ap soiquiour sone .p JOUUOU op 
yuowoor[dus onbeyo e yuRANO. os souUOsiod xne spuRLUOp 
ySo [I ‘OMeUIpIO sual] op oseyysidop sed oseuUOT[HURYd? | 
suep sumlu0d ‘Ulu ‘soyWUepr JUos yUoWsR;dwo onbeys 
e juvuoyedde uonemndod ev] ap soquiouw soy 39 QUUOTJOOI9S 
yso  syuowooRidwia.p sfduiis omoyegye uoljnueyoo uA 


seddei6 ua 38 sual] ap abeysidap sed eHheuuo}}UeYDS,| 9p UOSIEUIQWIOD : UlpuefuO|\ Je eUIPe-xI|e4 80Z 


“OOTXOY] ‘BOTLUIS URORITND 


‘BLIRJISIOATUL]) PEPNID ‘OTRUIS Op eUIOUOINY PePISIOAIUL) ‘SRoI}UIO}RI\-OSISIY SVIOUSID Op ejonosq ‘UIpIelUo|W] “gq Oped Jo RUIPS|\-xXI]9q “H UNIRW ‘[ 


‘(sored no suonriqey.p soy ‘xneyidoy ‘seq ‘o[duroxo sed) 
ayIqegoid aJ0J ouN ddA SOANO OO JUOANEd UOTeIndod 
BI OP SOIQUIDUT Sd] NO SaTqIssoooe syUstUDOR| UID .P sn SsUOD 
asepuos op oaseq oun Jed opaAnod jso g{QId UONeindod 
Be] op ‘opuvis snjd ey yuouomessoogu sed jso,u mb ‘ed 
oun,nb Juosoddns s]j ‘[entul t~nouJog op UoT[WURYS .p sed 
ayIssoo9u ou Inb sual] op aseisidop sed osvuuo][HULYd9 | op 
QyUeLIeA OUN JaIOgRIA & (POOZ) UOSdwoY] 39 eUIPS|[-xXI]O4 
assnod yuo sonbyeid suonenzis soy suep [entur uoTWUeYDE | 
ap jofns ne sosoyjodAy soy] ouleysnes e gNOWIp ey] 
‘JOUUOTINANSUI sTeIg gjodde uoTeI9S Op sTeIq UN yMpo.jUI 
mnb 99 ‘aorjod ap saysod sap 3a Q]URS OP SUIOS ap So.yUdd sop 
Jed stumoj} souuosied ap siolssop op udAour ne gsITeoI JOU 
-O[B1IDUNS jSO [ITU JUSUIDINIOSI 9] ‘SdT[991 SApNyd so] suep 
‘stojoqno} ‘saye89 soylpiqeqoid oaAe 30 JUOUUUepUddapuT sou 
-UOTIOIJIS JOS [RIWUI UOTTHURYDE | op s}USUTI[S Soy onb op 
-B-]S9,9 ‘TJNOUJOg op UOTTHULYdE UN jso [eHIUI UOT[MURYDI || 
ayjonbe] suep susly op osvysidop sed osvuuol[nueyps | op 
OJULLIBA SUN SJOQRTO JO (P66) SJopftus 30 YURI ‘oyduroxa 
wg “(ZOOZ WoYeYD9H 3° “PEG! Siopfiug 1o YURI “7661 


Slopliug MOA) “orlefsHes & So|IOUJIP JOS [eT UOT|HULYDE | 
JuvUIDNUOD sasoyyodAy soy ‘onbyeid us uonendod ap so.nou 
-eled ap diquiou ulezI00 uN.p jofns ne sapryeA o[9pou UN Ms 
SOOPUOJ SOOUDIOJUI SOP Ie} Op INOUUOTTHULYDE | B s}OULIEd 
sual] op osejsidsp sed oseuuolnueyos., onb ualg 
‘(QOOT YULL 30 UOsdu0Y, | 
onb isure ‘766] UseIdS MOA ‘suoT] op oseysidop sed oseu 
-UO]]HULYOS | Op ONAdI oun Imod) oyIeJsHes pos sI[qeigoId 
youe.p sor oun.nb oo e.nbsnf ymsimod as _ snssao0id 
a9 ‘souuosiod sanne.p JOUNUOU ap spuLUIOp oa. IN] ynod 
[I 30 UOT[HULYOS | SUP SASNOUT SJOTL JUOS [eNTUI UOTTHULYOE | 
suep efop sed yuomsiy ou mb sogumuou souuosiod sa] 
‘uonendod ev] ap soiquiow sanne.p JoulluOU ap souuosiod 
$90 B JopuPUap ap 39 aTqIo UONRNdod ve] muIed souUOsied op 
JEHIUI UOTTHULYSS UN JOUUOI}OTOS B a}SISUOD |] ‘SUSapULTO 
SMO]IAe SoT NO Lge sues so] ‘sonsoIp soy sUMUIOD 
‘QTIOWgIp sgooe.p no soayord soureumny suoneindod op 
osvUUO][HULYDI,| B USIG JURUDSAUIOD SPO} UN aNO d19Ae 
4So.S (qqq) suo] op oseysidop sed oseuuol]Hueyos .T 


uononpo.nuy “| 


‘osepuos 


op oseq ‘fojapour un Ins sapuoy oysoidde ‘oouejquiasieiA op wiNUITxeU faTIOWyIPp s9o0e.p uonejndod 


‘oruly uoyefndod ‘asepuos op uejd a] Ins sapuoy osydoidde ‘ormjdeoos-oinjdes ‘ouuatsokeq oyooiddy 


> SOTO SJOP] 


‘asepuos op 


aseq e] Jed oy0Anod uonejndod ev] op uonoey vy] op a][Ie} ve] op sed yuopusdap ou syuspgogid syeq[NsaI Soy (TIT 39 BOURTQUIDSTeIA 
op WINUWIIXPL NP SINIJVUISd Soy JUdSLIQ}OVIVD INb steIq op sowe{goid say sed ayuasoid ou jo satqeydacoe s}e][NsOI sap o109Ud 
ouUOp UOssIog op WOUd & SIO] Sop jURSITWN Ud SOALIOP SINdeUIT|SS,p sTQUIOSUd,| ‘soTqIe} JOS UOHeUTWIOU 9p sozTIqeqoid 
so] puenb (1 ‘souR[qUIdSIeIA SP WUNUWITXeU NP SINIVUISS xne I[QR[QUIdS LO} UOSe] op aLJOdUUOD as 39 sye[NSEI UOG 9p sUUOp 
sgsodoid smojeurysa .p sojquiasua sop undvyo ‘sayqrey sed yUOS OU UOeUTWOU op s9zt[Iqeqoid soy puenb (1 onb juonbipur 
uonejnus red apne oun,p syejynsoi say ‘onbyojdwise syyewuou op asoyjodAy,| snos eyop spoyyowW ey JURAINS Ud ‘aNNe,| 
32 deys}oog un jUesI{QN Ud NUa\GO sd xNd,p UN,] ‘asdepuos op urd 9d] IMs sopuoj yUOWOT[ONIed soURTJUOS dp SdT[PAIQIUT.p 39 
OURLIRA Op SINo}eUISd .p sodA} xnap suosodoid snon ‘uoyendod ap sayjre, sop jofns ne saoudJoyUT soy oMey Inod aystyUSNbay 
ayooidde | suoydope jo sinayeWIs9 sap UOTON.SUOD eI Joy]IOVy Inod onb suusisaXeq spoy}suw ke] SUOSTINN,U snou ‘Uepusded 
‘UOSSIOg Op LOL & SIO] Sop jURSTTWN Ud ane] 39 ‘UONe[ndod ap sale} sop sayoo0dUT LoL & SIO] Sop yURSTTHN Ud snud}qo 
JUOS sIMoeUINSd,p sayquissud sap xnoaq ‘suUsIssheq oyooidde oun snos sgauiap uoNeindod ap sajjie} sop simayeurlysa .p 
So]quuasud sto.) suosodoid snou 39 ‘uosdwoy] 39 PUIPS|\-XI[94 Op NUeLIeA eT op suoyed snou ‘apnys ayuasaid ey sue “a[qIey 
sed }10s ou ‘UoNeUTUOU op oyTIqeqoid ogjodde “uoursoe[duis j90 eB yURANO] 9s UUOSIOd oun Jed sUUIOU IOs UONeINdod Fe] 
op siquiowl un nb sy1[IQeqo.d P| ‘uoud0e[duIa onbeyp :nod ‘onb uonIpuod e soyqeydaoor s}e}[Nsoi sop yuoUUOp Inb uonendod 
OP So[[le} Sop SoURQUIDSIeIA Op UWINUWIXeW Np sInayeuIsa sap gsodoid yuo sInajne xnop sa] ‘uoyendod x] op soazquiow 
Sone .P JOUMWUOU op sjUsWOOR]dUId sod op UNdeYO B JURANOI 9S souUOSIod xne spuLUap UO ‘syUdWdOR[dUIA Pp UOTTHURYDE 
un.p uoTaIIS eT saidy “s9Ad]9 syTIqeqoid ouN ddAe SgANO OQ JUOANed UONeINdod ke] op sorquIoW say no sjyutOfstp 
syuousor| duis p o3s1] oun Jed oz19AN09 sd (opuvs snjd ey] JUoWIIessao9uU sed jso,u Inb) uoyejndod ey] op wed oun.nb asoddns 
uo o]jonbe] suep sual] op oseysidap sed o8euuo][Hueyos | op ajueLIeA oun gsodoid yuo (pN0Z) UosduIOY], Jo eUIps\-XI]94 


SUINSY 


, UIpazvluoyA] “Y OApag 39 LUIPOTA-XTA “H UAL] 


IUUdISIAB BPOYOU LT Avd 99}SISSv 9YDIOAdde ou : S9dYIVD 
suoyneindod op a[Iv} vy] AouINS9 aAnod sadde.as us osvuuoTHUueys9 ,| 
dp }9 SUDT] Op osuysIdop 1ed ssvuUOT[HULYDII,| 9p UOSIvUIquIO) 


LOZ 


enBojeyeo ne GdX-100-ZL .N ‘epeued anbisijeys 
QLZ-20Z ‘dd ‘Z .N ‘ZE IOA 
900Z e:quiecep ‘ayegnbua.p senbiuyoo | 


"PEE-LIE ‘OUseIOIg OpuLIDH ‘MNUUOD 
“Cp UouUaT “pq) ‘sanssy Juasing pun saaydadssag JOUOYDUAIUT 
> SONSYDIG USLNOT Sue ‘[aAZT [eUOISaI oy) Ye UONONpold 
WISLINO} [e}0] pue sIMpIpusdxea UISTINO} sINsvoU 0} ABSOTOpoYjoUl 
V (1002) “A HEA [Pd 3 ‘Sf Zonsumuog “Wt ‘Zoueqgsq 
“q ‘souoy “q ‘opsioyT “y ‘ezy “pf “vulyeg ey 9d “T ‘sepreA 


‘ysadopng 
BIYJQ JOONSYDIG JDAJUaD UDIADBUNFT ‘SO’sioIG aws1Ano] 
UQ UNAO..] JOUOYDUAJUT YIXIS AY], {CE SSuIpaad04q ‘(Pleqoig SOYV 
‘pq) ‘soovyd suojista seyndod ye pure syuswyst}qeisa UONepouUOSIR 
}@ SIOJSIA Jo skaams Jo suoyesodo [eonsnEIs UI sosejuApesIp 
pue susfgoid 0} uonnjos YW “(Z00Z) “I “Zoveled SPPIeA 19 WL 
‘Zoueqoisy zZopususyy “| “esoftjayy vyoeysng “q “elouezueyy SOLO], 


“88C-C8C 
‘uonRIDOssy yeosnejsg uRoLoUNy ‘Uuo1jIag SoISsIIDIG Jo1I20G ayy fo 
ssulpaaI04g “SKOAINS suUBY o[AyNu ur sJoyeumsy (961) “AY ‘puny 


“L8I-ILI ‘LZ ‘asanbua,p sanbiuyza J, ‘syuoua.ysisarud .p 
asejdnoo np seo oy :splod sop oseyed np oosiyeioues 
apoyjour ey sed uoneumsy (1007) ‘d “YorRD Jo “q ‘ogyfeary 


‘soyfoxnug ‘sosdij]q suontps 
‘sayJoxnig op dyISIOATUE),] Op suoNIpY ‘spiod sap oseyed np 
agsl]eIguIs apoyo BF] NO ‘orpul aepuos J] “(Z00Z) ‘d ‘O9T[PACT 


iC E-LOVG 
‘gjanbua, p sanbiuysa J, ‘spiod sop oseyed np spoyjou ey op opre.| 
B SoseUSU Sop 39 SNPIAIpUI sop soidne soguUOU soTeUTpNyIsUOC] 
sojonbua sop osyesioasuey uonelopuog (S66I) ‘d ‘ooT[eary 


ansojeyeo ne GqX-[00-ZI .N ‘epeuerg onbysyeis 


“wumo;npuad 
NOU op AIS WNHOWRIIIsSO wnIsojoIoH (€L9T) ‘OQ ‘suasAny 


‘811-66 “9E ‘D SoLlag ‘pAyyung ‘suoneoryde 
pewojes pue ASojopoyjour owey opdnin (rL61) ‘OH ‘AotueH 


‘907 

-€0Z “UONRDOSsy [eonsneg uRoLOUTY ‘uOljoag sosyD]s [01909 
ay) fo sduipaaz0¢g “SKOAING swue1y sJdnnNW (7961) ‘OTH ‘Aone 

“sapoylaN TASNI ‘sanbysyvys 

alsojopoyjaul ap saauanol sap sajop ‘ouseyoIg Ud sUWSLINO} 

3] Ins ajonbus,, e uonroyddy ‘spiod sop oseyed op spoujou 

R] suep (poy ‘ayqrey) ayyeumjdo.p suonipuos joa uoNesUO}R] 
‘uontsodwioy ($00z) ‘WW ‘Aumeyy 19 “_ ‘ogyfeary “D-¢ ‘oy[iAod 

‘O6I-S8I ‘7 ‘TE ‘alanbua, p sanhiuysa J, 


‘splod sop oseyied np s9si[eiouas apoyo ev] op syuoWopuoy 
SXT :pompul osepuog (9007) ‘d “oofeaey 30 “O-f “OlflAod 


78-9 “98-S8-r8 ‘SapoylaW FASNI ‘sanbuysyojs 
alBsojopoyjaul ap saaudnol sap sajopy “ane IUN.pP JURAIOS os Ud 
uonejndod oun Jodenje yusuUOD : op IAIns { soyonbua soaxyne sop 
So][o-JUSIgIJIp tonb ug : joued sed sajyonbus saq (6661) ‘O-'f ‘aTTIAAd 


ay deisorqr 
‘9}X9} 90 OP PITIQIST] VI Jor 
-Ol]oule & INQLyUOD yUOUOpULIS JUO INb g1d0sse MdIIPE,| 10 


SONIGIe XNIP So] JUSIUDSNSIMa]eYd JUSIDIOUIDI sINd NV SI] 


SJUIWIDII.AIUIDY 


awsiuNo} ne uoled|dde uos ja JOSulpul eHeuuo||iWUeYOS,p spoyuJeW e] Bp SUOISUS}Xy : pueIWag-AWNeY\ }2 AI|IANG 902 


ansojejeo ne GqX-100-ZI oN ‘epeuRD enbrsneisg 


‘Q[oTAe [NYS UN Ud IOUS B ITIOYJIp jS9 9}9]duIO09 
a1so;Opoyjew ev] onb oy10s ap ‘ajgnbua | op uoNesieos ey JUEp 
-uad 39 JURAR Soy] 919 JUO oIUdS 90 Op SapMjd somNe.q 

‘QPOYIOU puodas vy] DUOp sIOFOId UO ‘ayURPUOge 
snjd nod un sasuuop op 9399709 ouN.p xud ny ‘so[qeoisesop 
SOIMSOUI Op SINdLA.p onbsi I] IMD jeJ 39 OpIMO] JUOUOA 
-l}e]O1 UOTWRSTURSIO SUN je} Ud SpuLUOpP “UOT HURYDI,p dIITe} 
ap ould} ud astoaid snyd ‘oun J ‘sd0UdLMOUOD Ud SdSTU aNd 
quoreAnod sapoyjoul xnaq ‘ousedured osvi Ud SYS UN,p Sind} 
-ISIA Op SIQUIOU NP UOHeUIT}SO J 189 IND sayfa .p un] v spsene 
}S9,S UQ ‘spiod sap aseyed ne syuours[dur0d yo suoneidepe 
sosnoiquiou ap Yomnbes spoyjewl Pe] JUepusda, ‘o9}INU eT NO 
9}S1IN0} 9] ‘onbystmo} sseusut 9] “INolEs a] ‘aSeAOA dO] : OUST 
-no} ud sayuouTJod sonbysnejs soyun soy Ms opmjyoexo | 
B SOOIAIOS Soy] Ins onbysynRs spnjyoexa | op Jossed op yourstod 
sptod sap oseyed op spoyjow eT ‘saysiiqeqoid suo7[n 
-UPY99 Sop dIINSUOD eS UO sjoNbse] Ms SddIAJOsS ‘SUTLLIOO 
Op UONPUILOSUOD eI Op IMed k& So}SLINO} Soy IISTeS & d4SIS 
-U09 dI[q “OWISLMO} np onbysyeis eT ve s[quorjdde spoyjow 
Q]JoOANoU oUN.p soUusT] sopuvsd soy qUasoid wv OJOTIe 399 


uoIsn[Iu0,D 


‘apoyjoul 
Qpuodses vYI sdUdIOFOId op vsonbijdde uo soayIs soy sno} ms 
‘uop onbyeid uq ‘ay[nsai Us Inb 9}990][09 ve] op UONRoOyTTduumIs 
RB] NA g[qvig[o} Wey e no} yso Mb 90 ‘UorIsIO9Id OUI eT] 
Joyiodde mod syoosdde osorueid ey onb sod snyd atuuep 30 
SIO} OUN UOMAUD UOTTHURYDE UN Nb ojIssao9U ou aT]Tq ‘onbysi 
no} oseugu np uONIsodwos vy] su9}qo mod joRJUOD sues 
osejduioo un nb asioaid snyd 4so ay]q “mojgnbus jnos un nb 
DISSOOOU OU II]9 IVd [OUUOSIAd Op SOLID} Ud Sd9sNdjNod SUTOU 
yo soyduts snjd uleua, op suoneisdo soy puor oyooidde 
apuoses ey onb omp ynod uo ‘uorsnjouos ssomueId ug 


ugg] = ul 
B a]eS9 JOS 
7s wor WUeYOS | op w oy]Ie} eT onb yWyNs JI ‘77 IMayeurnsa | 
onb soueliea ougU ey] ye “7 moyeuINso,] onb uye ‘ouog 


Uu 


3 x7X OL = | az [x20 


eopesa 4] 
INDUS | Sp souRLIVA 9UN sUUOp sydol1dde ssorwoId BT 


UI 


ei cdctae € x .O] 
— a x 
I LE y 


|“ jsea 


oe 


SOc 


77 IMOJCUIYSA,| Op VOURLILA PJ JopNoTeo ynod uo “UIP 


B UO ISUTY * INO}LUINSd | Ip 9OURLIVA P| 
yojnoyeo suoanod snou ‘"/!¢ suossteuuos snou onbisng 


(el oe emma Eonwan ey Jenteal ee Te 
Ligeee eClaggS Lata OC Oat OS piel 


Ks 
foe) 
| 
TES 

Jw 
IN 
+ 
| 
+ 
—_— 

+ 
N 
See 7, 
| 
ae 
Ww 


® UO ‘UN JURADp puRIs JOU 
-uiesyjns yso 47 onb jyuesoddns ua jo (9°g) op suoneoytyd 


“uns sgidy *"/'¢) op UoHeUss oun JURBUDJUTeUI suOTNOTED 
£= ARG 
° OOEien S OOS Er. 
cae cg cee 
I 001 I 08 I 
OOS we OUCH a ¢ 00e" eT] A 
— X — + — x — + — xX - = 


09 I OV I 07 I I 


> B UO ‘JOIJO UY ‘SION ap jsa 4 siasessed ap usAow siquiou 
YX] ‘oy uonendod op SUOT]DALION So] JUROST[S9U US xnop 
B g[eB9 ys 7g DOURLILA VT “o}IS 90 INS SMOJISIA QYE B UO 
‘IsuTy ‘souuosiod bulo e samMjIOA ap % QZ ‘souuOssod ayenb 
B SOMIOA IP % CZ ‘souuosIod sION ev SdINJIOA AP % YZ 
‘souuosiod xnop & SAINJIOA ap % QZ ‘OUUOSIOd oUN B SOIN}IOA 
sp % 0c & A [I.nb asodns ug~ ‘soImIOA QO = 42 SuUOp 
ousedured asel ud oyS UN.p onbruvosul majydwios uy 


mnbLuQWINU UOH.QSnIT]T °6 


‘€ yo 77 sojqeuea sop 


g]JomjuaAg souepuodopul 


UOU PI & SOOT] SOUL} + 
[4]1eA E 4 [201 re 


[Jaen $7 + “7 jae i [cy fava 


Vv 
v 


900Z aiqwasd~ap ‘ajenbuse,p senbiuyos | 


yee UO sJOye soyUepusdapul 
sed yuos ou 4 30 “7 sojqeliea soy IS °7'g onbavusy 


‘sTeIg sues yuouToNby 
-ojdurAse jo gsteiq iso “7 ImayeumnssT ‘[°g sonbavway 


‘a 
JQIOUL.P I[QVUIeA kT Op [Joo JUoWOTeU yo “7 IMayeUITSO,| 


ap af[e0 yuonbgsuoo sed yo {4 MoJeUIYsd,| Sp SOULLILA PT 
JUDWUOTIOVT SeUUOD OUOp jnad UO (6'g) B 19 (Lg) B BORID 


ag We ee 
: I I I 


Jed s9uutysa an9 
ynod uonrjel oy90 ‘onuuooul jso “7 gyQUeNb e] OWWOD 


(6'8) 


, y | ane been! n/T 
(3°) [: "8 aT GAR iS 
c 
B o[ed9 4S9 5 JouURLIvA PI ‘UOTIUIZEp Jed 19 
pea eal 
(L’8) CAS Pree (ered [A]eA 


(9°g) 90A8 ‘OJOOUS NO 


A 
| 2 hen xX A= [A}eA 


e UO “JUOWOTeUT] 


seat « (4) | 
TARO 7 ts aa 


yUdTI}G0 UO ‘yUonbgsuOD Jeg 


A A A 
. O + = I — 
Ben ow S| 1 


omio9 jnod uo | anb suonbsewi1 “ejao Inog *(9°g) 
yueyors { IM}PUISS,| 9p SOURLIVA BI Jo[NoTeO & 9}SoY 


SIINJIOA ap ssvuUOT]HULYII 
sues “7 ap ANa}VUITNSI | Op VdULLIVA BL Op NIeD 78 


ansoyeyeo nev GqX-T00-ZI WN ‘epeurd onbysneis 


as ae! Rae A 
i — — — |=] — |Je 
2 I I I a 


B Q[vd9 JSo INb SOURLIVA BS JOTNOTed SIM9IIIe .P 
nod uQ “*n sop onbruowuey suuskour ej 3s9_4 39 '2/] Sop 
onbidura suuaXouwr vy ayuasoides gynuenb siatusap a0) 


(9'8) 


in 1 yo 
(¢’8) fare a 
I 4 I I 
oJUBAINS 
suyese | o109,p jouljod snou gyyed9 sJOIUIOp ayog 


ds3y 


Mit << 
(P's) a 
dJOOUS NO 
ds>y 


ry Ko 


dsDy 

Ux 

OJULAINS UOSE] VL] OP JUDWIITLS9 JILIN ,S 

nod 4 IoyeurTso,T ‘siosessed & & SINJIOA oUN sUEp JULI 
-eAOA UOTHULYD9,| ap souUOsad ap siquIOU 9] so “Ww NO 


Vv 


A op JURAINS IMozeUNSd J SJOTe SUOSINpO.HUT 
“4 sQuenb ey] JOUIULIO}Op op iggns pI ‘47 moayeurnsa | onreu 
09 mod onb 97e1SU0D UO ‘uoIssordxo 31199 JURAIOSqO Uq 
uO JUSTUSIIeJIed yso 47 SOIMJOA Sp [IO] dIqUIOU 3] NO 


(€°8) DAW SS 

OJUBAINS 
OUIOF B] SNOS }LI99 (S$ af JL op Ineyeutjse un quonbgsuos Jed 
(78) Pili 


77, op omnquioe 

S1oUIap oun JoUUOp op joUJod UONRIOI sIOTUIOpP 3100 
“slosessed 
M 8 OIMIOA oUN sUep sonUdA souUOsIed op oquIOU 
I “W 39 siasessed & & SOINIOA Op diquoU 9] 3S9 “7 NO 


49>] 


T= Tees 
Pee Ree. LER 
ee eg I a ae 
UW Re 7S a4 la 


SULIOJ BI SNos JoUIdxd ,s 
ynod { OIN}IOA ouN suEp siosessed op UdAOW dIQUIOU JT] 


(1'8) 


47>] 


ikea a 


e@wsNo} ne uoljeoidde uos }9 yOouIpUul BHEUUO||NUCYOS,p epoujJeW e| Sp SUOISUa}Xy : pueJWEg-ALUNeY }9 aI|IAOG v0Z 


angojeyeo ne Gq@X-100-ZI oN “epeueD enbrsneis 


yuoatesa suojoddey 
‘] OINJIOA eT op siasessed op siquiou 9] sUsISop ‘4 no 


49>] 
<] sane 
Sa Gao 


oUPAINS oITe39 | Suojaddey 
“L ep uopmysd 18 


(Z saqaq soy UO-}-9}dUI09) ajgnbud | 
ap suds ne siodessed op s1quioU 9d] UOISIO9Id DdAv ITUD}QO .p 
OSEIURAR | 9NO Ud B SpOyJOW aye ~¥ ouUOSIOd ev] o0d 
-suey e inb 7 amMpIoA ev] nod /a ze [eBd Iol ysa_ 7“ dIquIOU 
a9 ‘sovodsueyn ej nb 7 amMjIOA ev] op siodessed op 7 
oiquiou os] ¥ ouUOSIod v] eB JURPULLOp UD o]duMIS snyd 3499] 
-JOo 9uN IIUa}gO ynod UG ‘SoS sUTeLIDD IMS JOSITeOI B 9SNd} 
-nood 30 danbijdwiod JaI9Ae Ss nod aJUapsooid spoyj}oU eT 


SAINDJISIA Op osvUuUOT|HULYIE 
UN, Pp ApAVd & SANIJISIA Op d1quIOU 
Np Ans}vwWyse UN .p UOHIN.AYsUOD °g 


as REE: ye ih : 2 
MCS ae ee ae 
5, 

bes Galina 
NC Sica eS ae 
O 


9) “2 ry | 
oe doy, 


yUdTQO UO ‘s[noTeo soidy 


Ye 
“N= Se re = “um ‘YU) —— 
0=) a 2=(% re 


0 ON 
ee ey elcid de ‘wm ‘Uu te 
‘0=“OV+ 


i ei) ue 
¢ Aq A 6 ¢ 
Bees ell renee A) = OHS) 
E } ‘ (= Z| Te 
yustqo uO “Y “wu “U soTq 


-euieA xne yoddes sed soyjonsed sogatiep soy yueynuue uq 


(Ty) "(O-M@4O 44%) T+ 
Si Aes 
ral 
Se NED reo SES es 
it 
ul 
7 eS (28 “LE gd) + 
= 4g (ze x}=0 “ul “U) 7 
|e: (é pS C4 
€0Z 


ouusisuvise] UoNenbs | o11199 ynod UC 
‘DQ=uitg +u “9 

oyuTe.yUOS 

RB] snos w ‘u ud (Z]'L) syes9,] JostuMTUTUN OUOp Top UO 
‘sooxy 47 39 77 uoNeindod ap sayjre} sop mod 
A Ma eunses | op souewea ey] ostutur mb “4s yo ¢s suojyy 

-ULYI9 SOp SOT]Ie} Sop UOTVOOT]P | JURUDJUTeU SYDIOYO UO 
LL) peal ek 
Aq A _ 404 “a de 

a L 7A ay 7S A of 

“5 4 d 

7s (JS (Lite aDe 


z Se [z- l= 
a 4A 
q c cS G 


(OIL) 
ae39,| 9p dUAINS UONPULIOJsUR] PI SIOTe JOGO UC 
‘UM /[ JO U/T SOULIO} SOT JURADP IIQvosT[sOU 
So WU/T UI9} a] onb Josoddns suoanod snou ‘ayo uq 
‘(OL'L) ouyeso,] suep uoneurxoidde oun ome} suoAnod snou 
‘{ IMOJCUIN|SO | Op POULLILA k] Op [NO[ed 9] JoyT[dutts og 


gyydus sey 7°7'L 


‘0 = (90K D ACS abo) sar 
d Zod 
OES aD) Sele 
WD ONE) Uh DY 
W Ud 91SdpP SUIDISIO.Q np uo} 
-enb9 oun yUOGO UO UOWOUUOSTeI SWIOW 9] JURSIey Uq 
‘sonbuioumu 


Sopoyj}ol sap doae JoUTULID}9p jnod uO] onb ayja01 uoOn 
-NjOs oun jouIpe u Ud dIZOp sUISION Np UOneNbs ayj90 


eT 
0 = is Sew 3 ie )p)es EW ide 
(6 
d 
L 
Misra cA) ésér'9 i 
C 
IG bP R oe es OY 
71199, Inb u us 
QIddp SWIdISIO.N Np UOneNbs oun juSIQO UO ‘sjNoyeo soidy 
Ye 
‘0= —umiy+u 4 = i 4 \ 
) O=% ) a 
(WARN 
oe Aq Ag Ay 4 
; 7S 7S pb 


=.) BS (ESET) S (Ke “) 
I (6 C (G Te 


9002 eiquisoap ‘a}eanbue,p senbiuyoe | 


u sul ue 
eh ecere! vite oe = Diy \ 
quongo uo *Y “Ww ‘U satq 
-eliea xne YWoddel Jed soyjonsed sogauop soy Juefnuue uq 


(DM OutU AD)Y + 
OM Tes Sut Ue 
d uu 


L 
SS a+ SS alt 


(IV'L) 


be a AaqaA d 
7 SCS i hewmen i eax 
Uu aT, 
Ag A 
Pe | aS 
suudIsuvise] UoNenbs | o11199 ynod UC 
[210] 1NOD BJ _D 30 Souuossed xne sasod sameuuoTsonb 


sop (sdua} ua) nod a] 7D ‘sammjIOA sap Inoyne sasod saieu 
-uolysonb sap (a]dtuaxe red sduua ua) yn0d a] ausIsap 45 no 


sa}=C ‘We “U)T 


‘Daudgt+u~d 
oyUTe.U0D 
PB] nos w ‘uw Ud (QTL) SHTeS9,] JosTuMTUTUL SUOp Top UO 
‘sooxy 47 yo 77 uoNeindod ap sajjIe} sap nod 
A Ioyeumsa | op soueie ey ostutunu mb 4s yo ¢s suoyn 
-UBYD9 Sap SdT]Ie} Sop UONKOOTL, | JUBUDUTeU SYOIOYO UO 
“Lad Aq A 
7 ob 7S LA 
Cy 


wl 
SS Serreaiereiehictiny 
Mis Aq A d 
7 SCs NO Mig 
u a7 


yUST}GO UO “SOULID} 
So] JURSTURSIOSI UA 1 1) “PI ({-42)/ 1 = AS d0AR 


e a Y Aq A Aq A u 
Ag [is u-ts | 


Uu 
(4s- és 40>) a= 4 


ansojeyeo ne GqX-[00-ZI .N ‘epeueg onbysnyeis 


sJoye 
JUSTAOP (6°L) syesa,TJ “osTUIOI sues a]duIs oNOyegTe osep 
-UOS UN & UOT[HURYDI,| a[TUNISse UO “UdsaId s¥O oy SURG 


(6L) ‘[a]ae,a [“z]3eA + 
[f{]zea or + [4Z]teA LX = 
[Lalwen = “4 


quotjgo uo ‘4s UOTTWURYOS | UOTas JUeU 
-uolyIpuos ud ‘(¢€/9]) SuasAn}{ op owWidIOaY} 9] soide.q 


A Anajeuysa | sp suvlsea Bf op [NIV 7h 


‘syuepuodapul sinajyonbus xnap & sinodeJ SUOAR 
SNOU UTeLId} 9] INS Jed ‘aysITear 4sa osoyjodAy,T “soyuepuod 
-gput ssosoddns yuosos A yo “7 sayqeisea soy ‘oyns ey Jeg 


[‘« <q it a 
Tire 
yuesod ua 


(8'L) 4p = (> =4 


oII99 s nod { ImMoyzeuU 
-1]89,] Juanbgsuoo Jeg “wm /47 ke [esp 1sa im splod 9] no 


(L'L) 
Jed tuyap Moyeuryss—u 9] A Wog ‘yeuy omeuuon 


-sonb 9] suep omsouwl uo nb y919UI,p a]qeLIeA Pe] JSso 7 no 


7>Y 
1K aR =] 
SULIOJ BI SNOs 11199,s Inb 47 
uonendod ej ap { 3919IUT.p d[qQvLIvA OUN JOUISA JNdA UG 


(9'L) 


SO.IN}IOA 
op ssvuUOT[HULYdI UN Pp Sd I] SULP 39.19}UI,p 
IIQULIVA 9UN Pp ANI}VUISS UN. p UOHINASUOD ZL 


‘47 uonendod ev] ap 9931100 doURLIRA B] OUSISOP nS no 
u 


(CL) 5 


tAq A Aq A 
zo Lb 7S ob 
il e A d 
OS ome oats NARA 
I I 
8 o[e39 OUOP Iso 77 Op DOULLILA BT] 
‘OINJIOA 9UN sUep SoUUOSIed ap  UdAOUT 
SIQUIOU 9] STvIq SUBS oUTSa a onb jo “7 souUOsiad ap [e}0} 
dIQUIOU Np siIeiq sues moyeuIT}se uN ysa 77 onb MejO sd [J 


9lWSIINO} Ne uoleoijdde uos 8 JOSsIPU! PHeUUO||IJUeYDS,p BpoUjJeWW e] ap SUOISUS}xy : puesUag-AWNeYy }9 OIIIAOG Z0Z 


ansoyejeo ne Gq@X-100-ZI oN ‘epeuRD snbysneisg 


juesod us 


As3] Uu 


(pL) ties tia =" 


{1/4 WOIsNjoUT.P gIIIGeqord op yo U oT]Te) 
ap SOINJIOA op duns oMoyeg]Te UOTTHURYDS UN “4s IMs 9pUoj 
Inoyeurnsa—u aj 47 yWog “<7 ap Mayeurryse un suosin.ysuod 
juonbasuoo seg ‘nuuosuI yso “7 souuosied ap [eI0} oquIOU 
J] ‘ayuapsooid uOTDeS eT SURP 9UUOTUDUT B] UO OULD 

"] DINIOA BI SUP SoUUOSIod ap dIquIOU 9] Js9 /4 NO 


“N?1 
(CL) SOK Tae 


du[e39 | Issne & UG ‘souUOsJed sap sIoATUN | oUSIs9p 77 NO 


“034 = =o 
TK =" KK = 


INVA JIS J] JULJISIA SoUUOSIOd ap [BIO] SIQUIOU JT] 


(Gp) 


tc 'L inod ¢7 ‘ajonse yoo op uy ey & nbsnl yo or esast{yN UO 
‘SuOT]e}]OU Sop JUDUIOSaTI[e Pp Tonos un sueq *[*L sonbaewosy 


‘SOINIOA Sap sIOATUN,| 47 39 soUUOSIOd 
M&M Jueyodsuey somMIoA ap siquiou 9s] s}UasaIde1 *7 no 


“nN?! eee 
Roy LG 4) 


INVA SOINIIOA Op [eI0} sIQuIOU oT 


Gey, 


_ £ op aouvliea jo uONMYId = TL 


‘sold of qeast[sou oimsoul 
op Nad ouN daAe NUUOD so 47 OU [e}0} dIqUIOU 2] JOP 
SOIMIOA Soy] Jo}dwi0d mod govjd 939 e& yUaTeAINbe oUI9}SAS 
un no onbruoqosya [100 UN NO POIpUd | JUOSsTyOURY Inb 
OINJIOA SUN SUP soUUOSIEd ap sIQUIOU 9] SAQTOI ‘aIIP-e-3S9 9 
‘SOIMJIOA Sap syuvdnd90 ,p dIqUIOU 9] (AuUISTMO} Np susioneid 
soy Jed 9siqn UWId} 9] 489.9) « JURUUO}eq» Ud dAQIOI 
mayonbus un no sed og] suep jso uo ‘oydessesed 90 sueq 


SIANJIOA 9p ssvuUOT]HULYyII 
UN, Pp AHAed & SANDJISIA ap d.1quIOU 
Np 1n9}vuUIyss UN ,.p UOHIN.AYsUOD *Z, 


"SOJULAINS Q 39 / SUOTIOAS So] SURP sodddoy] 
-oAgp juos soyooidde xnop sod “dIMJIOA eT SUEP IN] DOA 
yuoseAod Inb souuosiad ap siquiou ay suUOp Inb 9s8o0.uQ}UI 
NPIAIpul | op Imred ev ayHuenb surg ey JoUNNSe e soUT)SOp 
}SO JO SINOUSIA Op UOTMURYDE UN asTTIN sYydo1dde spuodsas eT 


LOZ 


‘OHS O] INS SIMIJSTA SP SIQUIOU J] JOUINSS & SUTSApP SOINIOA 
op osvuuo][nueyos p ouiajsAS UN IMs oseq 9S dJOTUOId 
eT ‘(j onbsoid no) yuouranbrun samjloa Ud so[qissaooe says 
sop Inod sioeumof smoyIsiA op sIquIoU Np UOT;eUISS.p 
soyooidde xnop Joddojoasp vA uo ‘QMS ke] sued 
: : S L / Vu 
oe : u olmpop op ule sioieumof smoyIsiA op siquiou 
J] sloye suse Uo ‘autetqoid 90 JoUMO\UOD Nog “Pal 
mod ‘g ouop 19 x11 juoutoyomp oA sed suop yned ou uC 
‘uonendod ve] ap (SOUSIA ap SIQUIOU I] IDI) SOIAJOS Sa] Sno} 
sed yreuuo0d ou uo ‘Pp a[quiasud | suep ‘Jayyo UY ‘QUUOp Inof 
UN B O}IS d] INS JURUDA *..27 9}0U ‘soUUOS.od ap [2}0} SIqUIOU 
3] sed JUSWOSNOMaY]eUI WeUUOD OU UO ‘sed SUTeLIDD SUR 
‘qusedued aseI Ud SaNbISLMO} SOUS SOP SOJISIA Sd] 
aua9u0s Inb 90 mod Jotfnoed Us ‘somel[IXne SUORULIOJUI 
S90 Op SOUTRYIOO Op UONPUIT}SO,| Op MIO IMs IO1 JO,SISUT 
WeIPNOA UGC ‘JonULYD ayNe UN 4sd dSLpPUOS op SdIBOpP SIOAIP 
XN 39 SASeq SISIOAIP XNV SOATLIOI SOMCITXN SUOTLULIOJUT .p 
uonesyyn. 7 ‘spiod sop oseyred np uonesiundo | susaou09 
mb 99 gfeusis elap Be uC ‘someyuoUTa{du0d soyoIayool 
SOSNIIQUIOU ZaSSE .P SISSd9U & DUBSLIOIG Ud OUISLMO} d] Ns 
ajonbuo | op sovjd us ast vy ‘ayeusis efap e.] UO SWUIOD 


sUSsedUI¥D dSB.1 Ud OJISIA Op SyurIOd sa] 
> JoyNIHavd sugiqoid op sduroxa uQ, ss *9 


(S007) Auuneyy 
JO dOTTeART “OT[IAOG sUep d}LID9pP Jso oUUOJOIG aonbud,] 
op uoneoydde J (9007) e9T[eART 19 9][IAoq suep 9.quOU 
yso JI ourut0s *"@ sual] ap sorneur e] Jostudo jes UO ‘IRF 
oq ‘SAIeU SUD ddI9pISUOD aQ-jnEed sptod soy sJaseyIed 
Inod 9}L19Ep 3j9,p yoIA nb ompeooid ey *[°¢ sonbavwisy 


‘((ZOOT) S9TTBAP’T 2) souRLIeA ve] Op 
uoTeUIsa | nod no sJanjouod uoneumnssa | nod z10s 30 onb 


Jornonsed owgiqoid ap sed asod ou *, 2 uonefndod ey suep 

no ,,Q suonendod say suep jos 90 onb ‘xnv}0} ap sULIOF 
SNOS SOIIeI]IXNe SUOTJVULIOJUI Sop UONeSTTIIN,| ‘OUUQU oq 

“xneiguas sodioutd 

Sop [No[eo Ud spsnoy] Zasse UONeoT|dde oun nb 4sa,U dIJo Jeo 

oI agi]iejgp sed eros ou oITq “((ZOOT) eaTTeaey 3/9) sodiound 
SOUIQUI SIT UOTAS dTQISsod jsd soURIIvA LI OP UONLUINSS TJ 

: u/{| = 'Q uaz 7 o8eAoa 9] Jed 9sITNN 919 & 

f ao1a1s B18 T= 98 “YIN = gM y¥NO yN= YN 

onb suojON *Z UOTAS eI Suep danboAd GqOW PI Jed souuop 

aqJ99 onb anne 4sd,U syNUIOJ sad ‘sonbystmo} soseusut 
sop uonendod ey ms uoneuNss oun ke dude }So UC 


(q)'Y 
™M 


l ! ly ae 
Pg Bay Wg yay 


BOGE 


€ 


900Z aiquiasep ‘aj}enbus,p senbiuyoe | 


no 
any i aad 
red sterq sues , { [e}0} of ss0Te 


suse uo ‘(g)'Y Soy WeUUOD UO IS 39 ‘s}UepUOdaI sodIAIOS 
so] mod ‘g o8epuos ap spiod ap nof un.p juesodsiq 


(1's) 


‘'p yUUASsT[GRI9 | op Inof ne 
juepuodsani0s / soolasas op UoT[HURYDE-snos 9]: ’s — 
'p yUOUIOSST]q 
-e19,] SUep SoUUOTTHURYDE smof sop sjquiesua,, : Zs — 
SQUUO]THULYDS sjuatUAssT[QeId Sop o|quiesua,; : "Ss — 
ajonbus .p spotted ey ap smoo 
Nv SQUUO][MULYIE SOdIAIOS Sap s[quIasua | eB JURpuod 
-So09 1 sanbystmo} saseugui sap s[quiasua| : ,8 


yusIog *'y yUOtUASsI[qQRI9 | SP UONOUOJ 

ud UOT[HULYDS | Sp IseI} ap soJsop soy sno} 4ms mb 99 
suep ‘onteredde sed yey ou uo ‘suonejoU soy JosgTTe mod 

isa 

sues JUR}D dIIeJUDWUSTO aSepuOS onbeyd ‘soisap smorsnyd 

B UOT[HULYSS UN.p SUOURD Sd] }INS SBdIAJOS Op UOT[MULYD |] 

qeo sieiq sues sosoddns juos spiod soy °’Q oSepuos op 

sptod sap Jatoosse jnod uo sjanbxne ‘/ syuepuodal sodorAsos 

op UoT[HURYDS UN,p asodsip uo, onb suosoddng ‘dureys np 

SOOTAIOS SOP I[QUIDSUD | INS [BJO] UN SUTLUOD 31199 ,S JQIOJUI P 
[e103 9] onb anuow ve uo 4uapgooid oydessered a] sueq 


[¥30} UN.p SIvIq SUBS UOHVUINSY “Ss 


‘f QdIpUul | 
red soiodor ‘gq op ‘p ooumol ve op ‘p ap 'v 
JUOUIOSST]QRIO UN SUP SOOIAIJOS Sop s[quiesud,| :”9 — 
ee Lop wena 
| nod “’p op 'o yuowasstqeis un suep 'p 9sdIpUr.| 
ted soiodei ‘ajgnbua.p smof sop sjquissuay :/gq — 
‘D QOIput,| 
qed g19dai o][aAvID ey] op sJonnosoyne o8eod a] : fp 
“p gorput,| red sorsdai 
ajonbua | op dureyo np osessed op xno 9] sa: Sp 
'n gorput,| red s19do1 ayonbuod | 
op duweyo np soniosurjnoq sop sjquiesuay :'p — 
no 


(1), 3 mod dasa, 


*5af 'qe'p ‘ya'» [=] gi?! 


VLE LMG 


cS 


(Zp) 


ansojeyeo ne GdX-[00-ZI oN ‘epeuen onbysyeisg 


9J1199 nod Uo ‘sTeULIOSaq 
‘(ousRjoIg Ud sossed sof soy yUoUENbrun) 
Inofos np IMonsuoy] ey op 39 adnos 99 yuoWIO} Ib souuosiod 
Op sIquIOU 9d] OIIp-e-jso,9 ‘onbysimo} oseusu np ayijIe} P| 
ap puedap , X [e}0} 9] ‘sefqetiea op dnoonvagq nod onb Jojou 
ney [[ ‘ouse}IOIg US assed onbysiin0} sseusu aj onb smof 
op siquuiou 9] ‘sonbystmo} saseucul sop onbrydeis09s3 souvu 
-oAold vy] ‘ouseRIDIg eB] Op IMoWgUI.| e onbystmMo} sseusw 
9g] Jed gsuadgp [e}0} JosSpnq 9] ‘yAT}Oe oUTeLIDN oun onbyeid 
jueke souuosiod ap oquiou 9] ang-yned , x ‘ajdutoxo Jeg 


gf?! 


TX y= v4 gD) PHPO = oN 


qed TUL}9p 19g N 
910U *, 2 9p FHAPo J SO XNv}O} S90 op Jornonied seo ud 


7?! 
ms iK =A 


‘(2 wouendod x] Ans otutyep 
A g{QeleA ouN & JIRIAI [e}O} UN. P UOTEUIT}SA | B OSSOIDIUT,S 
uo | onb ‘oydutoxo red suosoddng ‘sonei sop no synoojjo 
sop ‘xne}0} sap one yuoAnod javajulp Sadawpipod saT 
‘guuop 7 onbysi 
-noj oseusw oy Jed sasyyn / SsodIAIas op oiquuiou 9] ‘op 
-e-]S9,9 ‘oajonbua .p sporiod ev] op smoo ne 7 ap syuap9o9y 
“Ue ,P aiquiou of “((2)_-7)preo = (g)'y Wuyep uo *, 3! 
yno} MOg ‘qd dUdIOFOI ap aporiod vy yUeIMp soseAOA sop 
g[quissua | ap ,_7f Jed eseuit | 3so ,  uoneindod eq ‘ajgnb 
-ud,] op dureyo np syuowassi[qvie .p sodA} sioy soy suep J 
OUdIOJOI op SpoLiad ev] JUBINP SIOIAIAS Sop S[QUUIDSUD,| SP 
Jed odeult.| S9 7/7 Je19}UI.p UoHENdod 919 ‘q sOUAIDJDI 
ap spouied ey op 7 saseXoa sap uonefndod ey ‘9 W0g 


(T'p) 


LeU OUR. f 


o3vA0A <— SOODIAIOS: Y 


“QOIAIOS 
99 op InoyestpyN 7 aseAOA 9] D100sse ‘ajgnbua | sp dureyo np 
sJUOUASsI[qei9 .p sodA} sto So] SUBP YG dOUdIOFOI op spotiod 
ej Juemnp f£ soIAJos no} e INb “7 UONeoTdde | WuySp UO 


39.19}UL,p soguivied say “Pp 


‘OIAINS BS INOd SJAT] UN,p NO spoIVIe UN .p UIOSAq 
sed e.U sousi] xIp ud owIdxa,s nb sgpt oun : sured vy] sed 
NVA Ud,U PIVO oNb JUDARS SINaINe so] SIeUN ‘OUTOUOINe OIE 
un Jopuoy yeunod onbsewel ayag ‘awgtqoid 90 e urd 
9] Ins saseq yUoUONbrunN jo sdvoJo ‘osnomMosII UONNyOs oun 
sloye WUIMOJ I][q ‘oINSY o]]o o]Jonbe] suep saseq sop s][quues 
-Ud | ‘euUOT]HURYDS s}1UN onbeyS mod “JolMUApI MOANnod 
OP UONIPUOD FJ B oye.IJS SUN SUILIOD aSepUOS ap oseq onbeyo 


@WSINO} Ne uoljeoijdde uos }9 JOSIPU! PHEUUO|IJUeYOS,P SBpOUJeWW eB] BP SUOISUS}Xy : pueIVeg-AWNe|\ 38 SI/IAOQ 00Z 


ansoyejeo ne GqX-[00-ZI oN ‘epeueD onbnsyeisg 


yUoUTa|duIIs jno} JURIEpIsUOD Ud sUaTGoId 90 e onbrdde_.s 
ddDW eT ‘(surou of mod (pL61) ApeH 1 (8961) 
puny “(Z961) AopieH) cumesoyy] syuvpuoge oun ke nol] 
guuop ev suayqoid oJ ‘soydnynuu saseq op Inied e oseuUOT[N 
-ULYO9,| SP 91X9JUOD 9] SUBP JUDWUIT[SUIOJ adR]d 9s UO ‘a9ST] 
-N spoyjoU! vy Op owe UONUYESp Jeg °7’¢ sonbavway 


“QJUdT]OOxXO 939 B aJonbua | 
ap jdaouos ne siosurynog suesiie sop uorsoype.| ‘oyouPAdl 
uq j Nyoxe isa ua “7 adnodss 9] Is yuoWOnbrun syuoWst[qei9 
sas suep sajonbue say aydaooe «Dd adnosd a] ‘sousrosuo 
Sd] JUSIAT] aS onb nvaynod ne syn] ek] SUEP jo SJUDUUTASSTIQRIO 
S90 op ggUgsOIDIOY,] SUP epIssI ouug]qosd 9] “eT sie 
‘soyoreuiodns sop oijJ0s ve] eB SomeuUOTsonb sop sed o9.mjdeo 
919 xno aynop sues jnd uOnRUOUTTe | ‘oO oq 

“yUOWOS 
-Ioqoy,p sepoul sjualayIp sop ojduioo uslq (QUoANe} 
-yuenb jo yuoWIdAneyTenb) uoutuoredde yuapual ‘pOOT 919.1 
juepuod susejo1g ev] op SonbiyeULg[quId soyIs Soy IMS JO SOLOS 
-UR]NOG So] SURP S9}09]]09 soATeUUONSONb soy ‘smayie eg 
“SOUISTULSIO SIOAIP Jed soyrey sJQUUOY ayTTenb op sajyonbusa .p 
yofgo | yUOWOIOTTNSEeI jso nb ‘oTPOAVID eT Op JONNoJOWNV 
asvod ne osessed of Jed ooovjdwor jo s9uUOpuRqe 
2.9 np e sJonbua,| ap Jytsodsip np omred aya_ ‘syuaT[D suoq 
sma] B SameuUONsonb soy « JUdWATJaWUASsSS » JUONGLASIP 
Jo omlojegye uoT]HURYOS.p sousIsuOD so] sed juoUNyOsqe 
yuo}oodsai ou 1d-xnaQg ‘sa}onbud sap UOTOEI9s Op snssad01d 
3] suep sIOI[DN}0Y sop UONUdAIOUI.| & sol] sonbrydonseyeo 
SIBIG IP DOUD}STXA | SUOUT JUO FOOT 919,] OP S}S9} Soy “xnel] 
-IUIe} Souls 19 ssuIdures ‘sja}o9y Ud JUOUASJOQoY | Nog 
“SOINTUUOSTRS Sdd|QnOW SUOTeIO] So] od Tu (dITepuoddas 
SoUSpIsoI ‘ste ‘sjuo1ed) pueryoreu uouU jWOUdSIOQ9q,| 
Iod 93901109 o8epuosS op oseq ouNONe ‘ploge.p “eu UO 


‘a]qesijeos JUS 
-9]IOYJIp Jso,9 onb aQuour onbyeid ey] ‘ad1AJas 90 & 99] JUOU 
-Q{99IIp aseq ouN JOsITHN.p jomjeu pered [I 39 QuawUIasIOgoy,| 
B SOI] SO apszuno] Np swWgUI UOTUTJEp eT “T’¢ senbavwisy 


‘Quuop nol np sMAyISTA op d1quIOU 
3] OIIP-B-1S9,9 Uone[ndod vx] op aq[Ie} ey WeuUOD UO IS 
d[duIs aTojegTe ISEpUOS UN dIIP-k-4S9,9 UdT][NOUING 
uoT[HURYDS UN SUNOS dsIOpIsuOD jso guUOp of 
UN & « SOIAIAS »> UN.P SIMd}esITQN.p UOT] HUeYSE | ‘[euy 
ny ‘oo ms omdde.s oseuuoynueyos., (a;duroxe 
Jed neayeyo no sgsnur) stajoT]Iq oun Ied ayqissoooe 
}So SIS uN Ig ‘JUOWID}~OTIpP uUIT}so one sed ouop 
nod OU SIMOPISIA Op [e}O} dIQuIOU aT “Ja}duI09 assind 
[I.nb sues yuossed suas sop ‘omeuuonsonb un Jaydas0e 
yey ojyonbuos | onb yuepuad sed onbyeuraysAs-opnosd 
UO][MULYD9 : SOALLIV SOP INSU B SITOJBOTe UOT}OOTIS 
op soyjomiqey sonbruyse} sop uojas souuoy]MUeYss 
JUOS SMOJeST]YN so « SOIAJOS »» sap uNoeYyds Mog — 


661 


‘soddeis smorsnyd 
Ins gsijiqour jso sduisy ulajd e gAojduia smayenb 
-ud un nb ayusis eyoo yuoWONbyeIg ‘a][aAvIH ey] op 
Jarnosoyne osevod ne nb sure ays ‘aesue~nog onbeyo 
B JUDO TIOJeQTe Sonquye 919 v oddeis ou, ‘gq spoued 
onbeyo op soussowoy juowajstdwios « smof op 
soddvis » sop Tyap B UO ‘aTJOARID eT op JoNNoJoynV 
asved 9] mod jo ays onbeyod ‘olasuejnog onbeyo mog — 
‘Quowdaneurxoid 
-de siojied) « a81[go asessed op yulod » un suTyop 
Ap onbruyss, oyyiqissod ey mod ja g91I0}0U Moy 
Inod ststoyo seul ssuUOT[HURYDE sed JOS OU SOUIS SAT — 
‘(o]duroxa Jed sapotiod soureyi99 JuRNp 
SOINJOULIO ‘sIOSURTNOG Op sNyod) soyINzIOJ soouR|sUOS 
-IId sop Jed « 9010} »» nod un 939 ev adeIN 90 JUOW 
-onbyead se9 ‘sutow np yuouronbuosy |, ‘uouuonedde 
so]]o oyjonbey] ve sunuu0d ev] op soyedroutid ssouapisel 
ap siquiou np jo onbysiino} yuowras1ogoy.p oy10edeo 
PR] op jo omeye.p oyyiyo moj op ansed e ymsuO. 
« onbystmo} jayusjod » Imoy e sayfouuortodoid soy 
-T]Iqeqoid sop s0Av SogUUOTTHULYOS JOS soLasuL[Nog 
So] oyens onbeyd sueq ‘(ousejoIg ek] op IMOLIQWUI 
‘suojoiq syuouoyedap anenb sop « ayes} » oned 
> sayeys burs) yuowonbrydess093 synens onbissepo 
urd un uojas saguuOT[WURYdE JOS soLIasuR[Nog soy — 


: SQJUBAINS Sonbruyse} SuOT}BOIpUT 
sonbyenb say surowuesu elouuop UG ‘aT]o,p ouNoeY JaT[IeIOp 
Op BUCO] Sd WeIOS [I 39 SoJoTPNONAed sonbruysa} sop yormnbor 
(« ddIAJas »» ‘smnof ‘ouasurjnog) eseuuOTTHUeYOS onbeyD 

"xNd OUD Pp UNONe JUDTUOSUOD OU SoseUSU Op 
nod soy onb ‘sutow np yno} no “(aTJaAvIH eT op JoNNoJO Ne 
asvod ne osessed ‘ousejoig vy] op sonbneurgiquia says 
OP SOUSIA ‘SOLIAsULINOG Ud syeyoR) « SAOIAJOS »» Sap UN SUTOU 
ne oumuosuod onbiysimo, oseusut yno, onb joumpe uC 


‘QuUOp INO uN & dTJOARIDH ve] Op JoyNosJOyNe 
asevod ne juassed mb souuosiod op uojjyueyos un — 
‘ojgnbus .p smof op uoyuueysa un — 
: Soisop xnop 
B UOT[MULYSE UN dsI[eaI UO ‘ajo4s aWaI1S1O4] b] Suep UU 
‘QuuOp of un vB SdIIFOI SoyIS 
9] Sop un ms Juassed Inb souuosiod op uoTTHUeYydE UN — 
‘ojonbusa .p smof ap uoyyueysa un — 
: soisap 
xnop & UOT[HURYSS UN asT[VdI UO ‘azo.ys alualxnap vb] Sue 
spuuOp 
Inof un e sLasuR[NOg k] SURP SJUDT[D op UOT[HURYDE UN — 
‘ojonbus .p smof ap uoyWueysa un — 
‘soLlosurlnog op uoTMWuRYys9 UN — 
: SoIsap 
SION & UOT[HULYDE UN asITeaI UO ‘ajo.ys asaiuasd DI] SUC 


900Z siqwazvap ‘ajenbus.p senbiuyoe | 


‘OIJOARID BT ap Jonosojyne osead nv asessed a] *¢ 

‘Us RIO P] 
ap Sonbyvurgs[quid sazIs op s[QUIdSUD UN P SOJISIA So] *Z 
‘aLIosUL[NOG Ud syeyoR So] “| 


: SOIVS SION Op SONjT}SUOD JOU] 
-[QULIO} OUOP }Sso asNpUOsS ap asHg H] ‘SouID, sone Pp UY 


‘2 @P Bes SWISION e| 
anjzIjsuod asessed 99 ‘suo}dIQ SJUSpIses-uoU op sinol 
-98 SOP % OY SUIOUI-IN] asTIQ}OvIeD YOdsuR] op spout 
Xx) ‘OINJIOA Ud SUSeIOIG B] IP So}SIINO} sop sotos 
Sap % 08 UOMAUD ddnoJel INb aTJ9ARIH eT op JONNoI 
-ojne odsvod ne ousejoIg ev] Op jURVIOS sasessed soy — 
2 9p e.NS apuodds P| 4SO 
mb yutod 99 sed sadessed sop squissud | }S9,d ‘TUSp 
29 & « 98I;Go osessed ap julod » un ‘xna.p uNdeYyo 
mod ‘onbyeid uq ‘snuuos soy xXneI[Wuey no sISIO] 
ap NO sjomMyjNd sozIs op s[quIasUd UN.p SozISIA so] — 
‘2 op oyeys 
oiomuuoid oun yuRN{YSUOS ‘oLIasURTNOG Ud s}eYyde so] — 
: Jed sonjyysuod yUOs 19-xna0 ‘ayanb 
-Ud 9}}90 SUR] *« SODIAIOS » Op d[quIasud UN Ied sENySUOD 
1so_,Q onbiogy} uonendod ey] “qqOW ef Jest{yn mog 


aj39nbua,| 9p ssepuos sp uvjday ¢°¢ 


(G#qU/as)‘d ap sos 
ne 4 suep sosevAoa sap sjquiosua,| sUOp }so_, /) UOeIndod 
eR] Loy ‘sogynu | fas| x ‘u ouop jo | /as| samp op mofgs 
9] JUepuod saystmo} ‘u ayloduiod 7 o8eAOA UL] ‘sagIINU Soy 
30 Sd}SLM0} so] ‘sofas soy yUOs ajanbua_p saylun snos SaT 

‘asvAOA 9] 1S9 aJonbus | ap 72 anbiysyojs apiun,'T 
‘(JONSUT|SIp Soy Op USAOW UNONe SUOAR U snoU sTeUt ‘apotied 
oun.p sod ne saseAOA smoaisnid asey ynod onbystno0} oseu 
-9UI SUTQU UN) dseSuUP] Op snqe Jos9] uN ed onbysuMNo} oseu 
-OUI Op SULI9} 9] Issne eIOSITWN UG “IMoflas np sinod ne JSUT 
-O81aqay SUIUI a] DdAe Jo Molds stUOUT oT JURasEYTed (onby 

-SLINO} SSLUSU) Sd}SLINO} Ip d[qQUUIaSUD UN 4s9 aspAoA UA 
‘(gyediourid souapIsal eT BNO) H ap ssoy sogssed yuej9 fas 
Iofos oa] soide no JURA JUOWOZLIPOUUUUIT s}MU soy 49 sTedID 
-ulid souSpIsel sIOY H sURp s}INU sos sojyno} assed o)SLMO} 
3] Jonbnp smoo ne ‘| /as| gou /as ap yeuIpses 9] 99:mp 

ap d op /as o][eAsoqut un 4so “no/as un ‘94S1mM0} UN Mog 
‘(g9jmnu) ayediourid souapIsal es op sIOY H sup yu 

oun surow ne gssed yueXe ouuosiod oun 4so apsiinoj uQ 
‘(SOOT SAQUIDO9p op SIOUI NV COT JOLIAg op STOW Np pus}9,s 
mnb a]j90 snou mod) aauasafas ap apoisad aun J yO (SUO}OIqG 

syuatuoyiedap oyenb sap) anbiydpis0a8 dumyo un 5 Wosg 


}Q419}UI,p UoHeIndod ey 7"¢ 


‘syiodsuvy So] 
‘SIISIO] OP SOPAIOV So] ‘OINYLLMOU eI ‘JUSLUASIAQ9Y | SUILUOD 


onsojeyeo ne GqX-[00-ZI .N ‘epeurg onbysneisg 


« sanbyfizads 

NO SadIDjuawUaja SUIOSaG SANA] asD{SIDS D Saul]sap 
Sad1Asas ap sinig aj And (spd no auspjasg Db] JuDjIqDY 
sipsupdf NO SAABUDAJA) SaJS1ANO] Sa] aAPUlaj]D »> 
: JURAINS J] So aJonbud | ap odrouud a7 


ajgnbua,| ap syyoafqQ T'¢ 


VAIANO NTI Us IUISLINO} a3gnbUa,T “¢ 


ait 


a Mo re = 'z one 
av qv 


aN ysl 


Ae 
rs, 
ap aI]90 
@ onbruapl jso aTJ9 Ied sauIsa Jo a9TNoTeo aNQ-jnod .moyeur 
“189 490 op SOURLIVA PY] “OUIQUI OJ ‘SIvIq SUBS so, { IND} 
¢ Abi Vind ea is iar ti 
“BUISO,| “UOHONSUOS 9999 9 4.6 SV K/ gO = gO NO 


far ysat 


< ies i ah) 
aV x 

Jed souuop yuos sptod saq 19-9]]99 sueq ‘qqOW PI 
B SIMODEI SIOye B UG ‘sayIqeqoid sao Iu9\qQ0 .pP ‘a|qissoduunt 
ANOA “o[LOYgIp yuoursyespugs so I “(ZOOZ) s9TfeAarT 
12 (C661) S9TTBART] SULP SUUONUSU So [I SUTOD 7 9yTUN | 
ap ,u uoKos[9s op syfiqeqoid ev] op asioAU| ‘“m sprod 
SUWUOD JOSTHN.p Wespgns I‘, { IIMUI.P s]qQeLIeA oun p 
sieiq SUBS UOTJeUISO OUN IUD}Go Mog *,8 #7 mod Q= 'M 
dove “Ss ap 7 oyun] op UOKeUINSa.p splod a] so “M No 


I=! 
(2) Btn Cod 
gN 
SUIOJ B] Op INd}euUNTT}so uN 
sioye sn UO *,) sI[qQuWosua,] sgide.p sgmsoul ‘A SOAR 


(1'Z) 


no ‘2 91q!0 uoHendod ej ap , x 

JQINUL.P S[QULICA SUN IOUS ,P 3S9 yng 9] Is o[duwexo Jeg 
"78 2100 *@ ap 
7 sguUo]OO se nod onb tsure *,s 5 no “”@ op / sousty 
sd] Inod onb v5 Op SINI[VA SO] OTVUUIOD JOP ou UO “Wey U_ 
“& & suUdT] Op SOLNLU LT OP dyITe}0} ev] nod LO op smMo]eAa 
SO] SITVUUOD op oITessoo9U Sed jso_U [I ‘JUanbgsuod Jeg +, N 
Satan eet RIO to op sungjva soy Iua}go yned uo J onb 
esoddns uo ‘(,s op yuouaqnes no) ,/ ep sglynuopr / gun 
93no} Mog “sAneysUIUpe soIMOs ouN.p IMIJed B NO 9}90rIP 
onaonue Jed j 4“ ‘T=1 mod ne op SMA So] IUa}qG0 

nod uo ‘,s op f/ gytun 9yno} nod ‘onb asoddns uO 
‘OOINSOUT 


yso ‘A JQIQ\UI.p o[QeLIeA oun ‘_s ap 7 gytUN onbeyo mog 


g 


SlwWSNO} Ne uoHeoijdde uos ja JOSJIPU! BHeUUO]|IJUeYOS,p BpoUjJeWW Be] ap SUOISUa}Xy : puesUEg-AWNeY je aI|IAOG 961 


‘ysqseys-n' yew) Aumneuwiw : aLwno0g 


‘(Q0UPIT) XOPID OUNOASVULS P8OLO9 souBVossg gudyY ons ‘/ “INo\seg SINOT S}ISIOATUA),[ Op onbySHRIS 9p o1OeIOGeT] ‘pueIog-AuNey, WRIA 
‘IP TesuoM)a]]IAOp : [OLLINOD “(20ueIy) ZA UA OLISE ‘uueT-Joy op snduey ‘LSqyO/IVSNA ‘saenbugq,p onbysyeig op s0jye10gR’yT ‘ay]IAoq opne[D-ursp *] 


LOKag Oui? oS 2bEk pA? to sagh 

dIIp-b-4s9,9 *s 3 £ sgytun sop UdOUT Ne sagipUEp! 
gM ep soyun ,u sap gquiesuayt ‘78 WHOS “~< tO 
sojjonbsaj nod ~/) op 7 soyuN so] oyHUSp! UO *,s sup 
souuonosjas / oyun onbeyd Mog ‘/ gYIUN | op UONdEIIS 
op sufiqeqoud ey “QO < yu Hog “suUOp sseuUOTTHULYI9.p 
ued un uopes ,Q op Iyed e sgn ,u op ,s uoTH 

-ULY99 | SUUOTIIIIS UO 4OOIIPUT OSepUOS Np sed oI sue 
"SoyTUN xNop Sd] 9.QUd Ud] UNONe 9}STX9 U II 
‘uous ‘() < “0 aonb uoripuos & ,/) ap # 9yTUN | B O9T[O1 }S9 
,Q ep f oyun] Fp yuowonny 0 < Ep quowlg[a onbeyo 
no ~NX,N ate op ‘[,,6]= ”@ suoy op sorjeur oun 
red agquesgidoi og nod , 1 1 ,/ 2NUa soURpUOdsaLIOD 
ey] 7 Jed a9usIsep jso oyun onbeyo no ‘sayuN , AV JuRUDJUOS 
arly uonendod oun , 7 30 / sed a9usIsgp jso gyrun onbeyo 

no ‘sgytun , AY yUeUDJUOD stu UoHeTndod aun ,  yUaIOg 
(6661) 21149 19 (Z00Z) 
ITAL] ‘(S66 ) S9TTBACT & SIOAUAI UO ‘sUONeULIOJUT soydure 
snjd ap nog (ddOW) splod sap asvjsod ap aasiypsgua3s 

apoyjaul ey op adtoutid 9] JUSUTSANTIQ Soy Jojoddes eA UC 


spiod sop osvj1ed op o9gst[e.igues OpoyoU eT °Z 


(6661) 


aTAed 39 (ZOOT) seTteaeT “(S661) o9TfeaeT sed jurod 
ne Osi (qqOW) spiod sap aspjsvd ap aasypsguas apoyjaul 


RB] Ins yuowoyedioutid JaAndde.s va apoyo 9139¢) ‘TNoTed 90 
oey op youtsod mb spoyjsur oun Jayuasaid ap 3so o[oTIe 390 
op yng a] “SddIAJas sao ayUONbe.y yO nb saystmo} sap sprod 
op nof ne souUO]]WURYOS SddIAJOs sap sprod ap nof 9] JoT[OI 
sind SddIAIOS SUIRIDO BsNaMOSII USE] op JOUUOT[HULYDE ._p 
MITIGissod ev] MOAG yNeF [I ‘saystNo} xNe S{HeIOI s}oI9}UT.p 
sonourered sap JouNss MoAnod mog ‘seJapisuod ayenbua .p 


‘soydnnur saseq 39 939];duI0oUuT aseq ‘ sptod sop oseysed op sgstjeroues opoujs/ 


aporied vy] juepuod asepuos ap oseq BI dp SOdIAJOS sinotsnyd 
no un sloJ smoisnjd no oun Jostyyn ynod oys~N0} uN .nb 
JUSPIAD UdIG 3sd J] ‘sonbysiMo} suonejsoid sosnoiquiou 
S89 OP XNOI] SJUIIDJIP Sd] INS JOSOLOIUT ST Ip 19 SaxsLMOo} 
xne juousediouuid souysop sodolasjos sop JouUOT]WUeYIE .pP 
so “((ZOOT) ZORRP>d SOP[eA 39 ZouRQasy ZopuguUdy| 
‘esoftjayy ByoR\sng “elouRzURIY SOOT, 19 (TOOT) APA Pa 
yo zonsumuog ‘zourqaysq ‘souo, ‘opajoT ‘ezy ‘euryeg 
eT oq ‘sopreA) susedsq ud solimsy sop uorlsar ev] Jed 
sesiign elop ‘ayedioutid sopt,] ‘ouraqoid 39 Joumno}UO0S Mog 
"SOJSLINO} Sd] JUOWIDOOIIP JOSOMOIUI.p JURVOULIOd osepuOS 
ap aseq oun.p souasqe.| 1so smofeut soutergoid sap uy 
‘yuoutoddojaagp 
ap smojovy soy Muyop smod sjqesuadsipur so (a[duioxe 
Jed ‘ousejoig Ud ssouRvdRA Sop JuRUdId SUO}OIg Sop) [BUOISOI 
-PUI SUISTINO} np ped eT ap UOHENTeAd | ‘snd oq “« soroy 
-uo xne sajgnbus » sap aisojopoyjeul ey op Justs0R]dudr 
ud ajonbud.p sisojopoyjow oyyaAnou oun sovjd us omour 
ap aploap yO uUTeIA) op smojelodo.p jo sonsojopoyjow 
op amnsuood onbiuyosy gyW09 UN,p spre] doAR USRIOIG 
ap WISIINO], Np [eUOIsdy aTOyeAIOSqC,| lonbmod jsa.9 
"SoqnOI Sap pJOg ne sgjonbus .p uonesiess 
R] B IoIOgeR]JOO snd yuorIsap ou ddI[Od ap SddJO} Soy ed ‘saTeU 
-O1S9I-V.UI NO SdTBUOISSI SdINNUOT XNe Sd9}[0991 SUOTeU 
-JOJUI Pp ISSPU SUTeLIOD OUN IT]JIONIaI ap sy]IqQtssod ey snyd 
yUO U SI JUoASNaIMoYePY ‘oJonbus.p odAj 99 JOOUSUILUIOD 
-O1 JUSIvIOUITe SUISLMO], sp xnejUoUdyIedaq soyWIOD soy 
JO OUSRIOIG Op UUSIINO] Np [CUOTSdY oT10JeAIOSQO,T L661 
Iquig}das B [IIAP SpoLiod YI Ans dgsI[VOI 939 B (SUOJOIG Sop 
Q][99 STUOY) oUuse}OIg Ud s[eUOISOI-exd onbIjsLMo} uon 
-eyuonboyy ey ns yueyiod « saratuoy xne ajonbue » sup, 


uoHdINpo.wUy = *T 


> STO SIO] 


“UDT[[NOUIOG UOT[HURYSS UN 9.11) B UO JUOP UONe{Ndod oun ,p [e}0} 9] JOWINSd eB d9UT}SOp a]][9,p oun] eloddojoAap 
UO ‘SOTTRSSIO9U JUSIOAR,S SUOISUD}]XO SoUTeLIOD ‘aJonbud,[ e spoyjoU 9990 Jajdepe JUdWUUOD aUOUI soe 19D (100Z) 
UOIRD 39 I9T[BAR'T SULpP JUSTTATeSO ag}UASaId 39 (6661) TASC “(ZOOTZ) S2TTeAP’T (S661) 9TTeAv’T Jed jusuua0901 saddojaaap 
spiod sap aspjipd ap aasijpsguas apoyjau ey red onusajygo 3so uoTeIopuod ey yop JIauIpul aspUUO]YUDYIA, P aPOYjJaUl 
ey onbrydde uo ‘owrgqgosd 99 JOUINOJUOD IMO, “SOJSLINO} Sd] JUSWUDJOOIIP sApUIOe .p yUR}oULIOd osepuos op seq ap sdUISqe.] 
yso mofeur swefqoid oJ ‘Jostues1o.s snjd yuoaned ou « sorgHUOY xne sajgnbua» sa] ‘soJaINUOD SaT[oLIayeU sUOSIeI sop 
INOg ‘USRIDI_ Ud d[BUOISII-V.XO NO BUT SUISLIO Pp onbystn0} uoNeyUoNbey ve] ins yueyod ajonbus oun e Japgooid jlop uO 


suINsay 


, puv.Q.og-AuMey, WELT 39 a[TAoq opne[D-uvor 


JUSTIN} I] SUBP Saj3gnbUS xne 
uoHvITdde UOs 39 JIdTIPUL ISVUUOTHULYII, p IPO VI OP SUOISUIIX| 


Z61 


anbojejyeo ne GdX-L00-ZE .N ‘epeued enbysiejs 
902-261 ‘dd ‘Z .N ‘ZE ‘OA 
9002 eiqwisacep ‘ajanbua.p sanbiuyoe | 


“Uy 
‘suOoS 2 AZTIMA UYOL : FOX MON ‘“sjapopy ADEUIT “(1 L6T) WS “apteaS 
‘SepoA-Josuuds : YIOX MON ‘su1jdipg daaing 
palsissy apo (Z661) “f “UeUoIA 19 “g “WOssuomg “q-D ‘Tepules 
‘L8I-ILI ‘7 ‘LZ ‘ajanbua p sanbiuysa J, ‘syuouensisoqua .p 
osejdnod np seo oy :spiod sop oseyed np ogsifeioues 
epoyjpur ey sed uoneumsy (1007) ‘d “UorRD 10 “q ‘ogy[eary 
"sjossnig 
‘sayfoxtg op dISIOAIUA,] Op suoNIpA ‘splod sap aspjuvd np 
aasijp.1guas apoyjayy B] NO “JoeAIpuy asvpuog aT “(ZOOT) ‘A ‘3TPAC'T 
Bs Saf boo Pon) 
‘gjanbua p sanbiuysa J. ‘spiod sap oseyed np spoujoul e] op spre] 
® SOSPUSUT Sop }0 SNPIAIpUT sop soidne soguUaU soyeUIpMIsuUOC] 
sojonbus «sop ayesioasuey uonelspuog (S661) ‘dq ‘aaT[eAey 


‘6rLe I 
‘Iz ‘ajanbua p sanbiuysa I, ‘soseugut sop soidne joued sed saygnbus 
sa] nod uonesgpuod ap sepoms (S661) WL PUA 39 “H “Uoyey 


"SSOIg OMMUISpeoV : YIOK MON 
“AL0AY], BULAAJ]I PUD SASSAIOAT IYSPYIOIS (OL61) H'V “rysutuzer 


78-£9 ‘866] SADU 8I-L] sap anbysipoIs a1sojopoyjaul 
ap SAQUANOL SAP S2JIV 99-C9-P§U ‘Sapoyjau aasuy ‘anne oun,p 
JURAIOS 9S Ud UOeINdod oun Jademje yUOUTWOD (8661) “Or “OTA 


“6SI-SET ‘OUT ‘suog 
29 ASTIN UYOL : YOR MON “(YSUIS “CW 10 UOYeyY ‘H “‘Ueoung *H 
‘yAzidsey “qd ‘spq) sdaamg jaupg sueq ‘soyewnso Amey 
pue pjoyesnoy yeuIpnysuoy Joy sanssi SuNYSIOM\ (6861) “I IW 


ary dersorqrd 


‘yolns 99 & yUOWWAMIL 
-9]Ue 11199 939 WeAe Inb 90 op siped a] assedap mb gpore 
JOO Op UONSEpPsI eT SATIOW! JO SOTA “qdOW Pk] WowosorNd 
-ed 34a yOIpUl osepuos 9] mod joIg}UI UN 9d}SofTUeUT 
yuo mnb souuosiod soy soyno} JUOIOJOWIOI smMone say] 


SJUIUWIILI AIUD YY 


‘oquourap sed suOAR J 
aU snoU Is suTgUT ‘ayqrey UOHesMUNdO | dp dIOA ve] Jed yeyNsOI 
90 nuaj}go suomMe snou ‘yIOJ suas ne yUoWZTes9 gsmUNdo 
ano jnod uonEUNsea p sua{qoid oNoU Is ‘anno U_ ‘JOSI[NN 
B g[loey say yso oyjo.nb yo somos op anos ayjo,nb sored 
‘g[qiey uonestundo | JosyyN,.p suopueUTUOdeI snON 

‘soonb 
-Yduroo zesse suoneyel ep issne puodsp aq ~2 ? ,2 
suonendod say aqua suary ap odAj 39 oseuUOTTHULYDS .p sueyd 
So] sno} mod sed ajstxo U aq “A JQIOIUT,p d[qeUeA 9yNo} ap 


ansojeyeo ne GdX-[00-ZI oN ‘epeueg onbyysyeis 


[e10} Np UOTeWINS | op SoURLIvA Pv] JOSTUNTUTIU op yURYOULIOd 
SUSI] SOP SINICA Sd] JOANO] & d}SISUOD SLIOF UOTeSIUNdO J 
‘OOJ uOHestuUdo | op oilessa09U UOTIpUOS oUN yUoWOTeSE 
yso o[qrey uoNestuNdo J ‘onbyeid us ronbiydde e yo sajnoyeo 
B oplovy yso yo ‘onbrun uodey op otuyep smof{no} }so UoNIOS 
BT ‘ddOW ve Jed sympoid sprod sop souenea ey ‘oyun 
onbeyo mod “Jasmutut mod sesipyn,p yotauod jI.nb sual] 
Sop SINI[VA So] JOANON ke dJSISUOD dIqQIey UOneSIUdO 7 
‘OUOJ UOHSTUUdO | 19 J[Qrey UOTesTUUO | OARS & “UOTeS 
-IWUdo p SouIo} xnap aUd UOTOUTSIP e] Wey SUOAR SNON 
‘ddOW 8] JUenbydde usa sonuajgo suoneuinss sap souPLIeA 
B] JostuUT B UOSeJ ap 7 1 ,/Q eHUA sUAT] so] JouLIdxe 
Inod sayewmdo smayea sop xIoyo ds] aIIp-k-489,9 ‘oyyeurtydo | 
ap sug[goid a] spsJoge suoAe snou “UU_ ‘sUdT] op sooLyeUT 
OP SOWUIOJ SOSIOAIP 9dAe snUd}gO s}eI[NSOI xne ddIOeSUOD 
919 & oJURAINS UOTOES vy] ‘sed dySIxO Ud.U [I,nb no udT] un 
O}STXO [I.nb aip-e-3s9 9 “— 39 | SIMaTeA Sop Jed souLIdxe yUOos 
gQ P ,Q suonefndod say aus sual] soy onbsio,] ddOW 
®] Op UOesI[NN | Ns UONOEs oun QUSsoId sUOAR snoU ayINsUq 
“SIAISUB] 39 SOURLIVA BI Op [Ned ‘sTeIg ap soUasge : dqDW 
R] op sajyuveams sojotidoid say aQuUOWIsp suOAe snoU ‘sIng 
‘spiod sop asmpoid mod sasoqgery]e (ddI) spiod sap aseyred 
Np sasije1ouss apoujou ey ve onsnfuod yOoNIpUI osepuoS Np 
UOHeST[YN | Ip syNdsIp SUOAR snoU ‘aoe JUSSoId oy SUR 


UOISH|IUOD = *L 


‘a [duns omoyegye os CUO] WURYDE | Op Sed 
3] suep no sed juowoyeiouss BU XX ap aUepuodeput yo} 
ojeundo oun ‘uossiog op oseuUOT[HuUeYOS,| od swmu09 
‘Uod ‘(2 ep Juoulg[9 uN e JUaUTONbIuN sagIT ouNoeYO 
quos 1 39 7 onbsioy yMpoid os Mb 90 ‘[ x] UoTsUOUTIpP 
dp yso oyJa,nb no ‘sossz sap onb jusnuos ou ” OFT soLyeUT 
B] IS yUotIONS 39 Is onb a[qissod jso,u vjadg ‘sowesodurto0s 
SOUINUT So] MOAR HOP IM9}090A 99 aonb yp (79) sep 


N jhe) 
a rons | “HH 
heey Bae 


ap sousT] sap oumuOs 
BI atIp-e-ysa,0 ©" Oy op sousi] sop owuios ey eB [ouUOTod 
-oid mayo0A un yso 7°99" 5_ ‘sapeso quos 1° g 
ap soqyuesoduios soy soyno} sumo “Wey uq ‘soureystyes 
ang yuaAnod (qg°9) no (eg°9) “(Z°9) SUONIpUOD soy seo Jonb 
suep JUOUITIORJ IIOA suOANOd snou 4uanbgsuos Jeg “‘UOUTS 
019 “(A ep 4% gTUN,] & Sagl] ap-e-189,9) , op / girun 
SUIQUI BP] B SOOT] XNOp saynoj} JUOS 7 39 7 IS | Jed QuUOP S09 
“Ory ap adAy quowsye un ‘T ojduroxo.; onb o1reugos outoUl 
9] JUSUIOIOVXS JURAINS UY “SOIOZ IP « S9LMOQUIDI » ‘T IMITVA 
ap ZN ,N 9][le} op ofeuoserp soLyeut oun yso OH no 


spiod sep eHbeved np sasijei9ueb spoujelw eb] ap S}JUBWAPUOJ S97] : JOSIIPU! BHeEpuUOsS : sa|jeAe7 jo a\|IAeQ O61 


ongoyejeo ne GqX-[00-ZI ,N ‘epeueRD enbnsneis 


oA eal | (4 ,N) yN 
qed 
aguuop 189 YN Xx ,N ote} ap Oy someul-snos onbeyo 
pioge, qi ‘a]qrey uoNsnuNdo sed suous;go snou onb *° 4 <3) 
ayeurndo soneur ey Inod soyreysyes yuos '¢ op oyuepuodaput 
Ho} gyeundo oun mod (qg'9) no (eg°9) “(L’9) SuoTIpuoS 
SO] IS JUBUDJUTLUT SUOTFLIDA snou ‘/ yeI[NSOI 9] JURSTTHN Uq 
"uoUTS 
01‘, 9p 2 MUNI 10 {2 op / sun] oMUS UOT] UN 
OISTXO [IS | ane yessp tog ap jeummdo xtoyo 97 ‘aydumts 
amoyegye osvuUOT|HULYDS,| Op Sed do] SUP “IP JUOWWONNY 
‘(100Z) woreD Jo OgTTPART op 19 (ZOOT) S9TTBAP’T OP “(S661) 
you 19 UOYeY op s}eyNsoI sop suds os] SUBP JUOLIO}DOIIP 
PA [I Jeo ‘ueyodwI 4s yeyNsoI 90 “neoAnOoU oq 
(9°) quesTHN 
uo “°a, xneurndo sptod say suousjgo snou ‘*° @e°'@ 
= 8g oeumdo sommeu ey] gynojeo moar sade ‘ugug 
im qdo 4 ele. eT nda? a _ ido bere) soueu ey sind <1 9do ‘ 99 
ay ae So] ouINNsu0D mod smoyea soo suosTNN at 
‘GN °" T=2 ‘ojqrey suos ne “(, x)seA JuosTuUTUTU mb 


1 
oN _ 14d0 ‘go 


tS) 
if 
I 


soyeumndo sinayea 
Sd] JUOUIA}OOIIp suoua}go snou ‘(¢°9) ap yueyed ‘oyMsuq 
Soin btitht yN) a a EN Ge yN) _ np 


I ee N) aed 


suous}go snou 


‘(OL61) Fysulmzer suep ‘sone aqua “IaAno.y nod uo] anb 
[OILY BUT yeYNSOI UN yURSTTN Ud ‘SIOTV ° oN g]]1e} op yso mb 


‘ yN by Dy Si (ee yN) a 1 De 
eA ea | (jus yN) yN 
red squuop iso "°y sorneul-snos onbey9 *” °y 


SOOLNRU-SNOS So] SUCAB.}XO snou “Vy oq *,Q ep / sun] 
ee Iod jueke (« sayoof » op No) sual] op siquou ne 


[e839 "NV SOAR ‘AY OTTIe) op o9uteo come oun yso “ET no 
yN = 9N) pt 
(6°9) E — (“7 7)3er . ~ 
aie A 16 mats Wath 
ae ea AAT 
OV V V OV 4 V 
0) e I Ao) ie ee 
z aa | AG Ts ie 


S6L 


suous}go 
SNOU ‘[°9 UONDAS ¥] SP UOTIWSLIOJOR] LI SUOISPISUOD snoU IS 


[NI (I-,N) 4% ore 
Figs to We u— 5) yN 

qed souuop So yN X ypN oT [rey op AY 

SOLneU eT ‘sed 990 SUR “oIdUIIS oNOJeOTe osvUUOT[HURYDS 


wed ,§ uoyueyog.| suUOKeT9s uo], onb suosoddng 
a[dunts a.10jva[e oseuuolQueYysy : 7 oduexy 


‘K op ojUepuadopul 910} uoNestundo 
oun e nay sed jyUOUTa[Ge[qUIOSIVIA eIOUUOp sU ds{qIey 
oyeundo sed onujgo “%’e@ syeumndo someur ey ‘seo 
sone soy sueq ‘souuosied op a\sI] oun quest ua soSeugut 
Sop oseuUo][HURYoS,| 9p seo a] SuBpP sUTUIOD *,) Op 
9y1un g[Nes ouN kv sagI] JOS , / ap S9}TUN say Is yuouonbrun 
onbyeid ud sojyieysyes woos (qg’9) no (egg) “(Z°9) 
SUOTJIPUOD Soy ‘I][NOUJOg ap No UOSsSIOg op ddeUUOT[NULYDE | 
op seo a] suep onb omp suotumod snou ‘omypouod mod 

"A op suepuodgpur ovo} gyryeur 
-ydo p sed yuowiayeisues eme A.U [I ‘UOssIog op osvuUOTy 
-ueYO9,| Op sed oa] suep ‘op suoAnod snou ‘juonbgsuos 
Jed “jo JeI9UNS Ua o}IeJsYes vios INnb UONIpUCD ouN.p sed 
W138 ,S OU [I ‘SUOAOA 9] SNOU tUWIOD *,/ 9p / 9ITUN,] SIOA 
ual] [nas uN nb oysTx9 U [I.nb oyTusts mb 90 ‘{T}=7 8 9 
INd}OOA oJ Is JuoWIOnbrun emnpoid as yao */*%° Oe OV 
0'Pg— "gq onbsing ““g MoeA ze juowronbrun 
TUg|U09 WOp oTJ9 “(L°9) omeysnes od '7"@ ke oe 
a9 Wop Sates a0 “Oy gynuenb ey] owui0) (gN < aN 
onb yuesoddns iv)) soyuR\sol soyuesoduros f Nee aN 
S3] mod 0. 30 ‘sqjuvsoduros sororuoid aN sas mod [Gu 
—1)/ 22] = (22) anejeos 9] quonuoo °° ag) " By 
suo 00 ° *moI99A 3] “(Z'9) suostfyn snou Is ‘sioye *, 9 
ap / oyun WOU BY & SODI[TDI JOS 7 39 7 SoyIUN xNap IS 
"Sg[a.I0d sed yuos ou 7 op 
32 1 op sptod soy onb yey a] ourtidxa nb a0 ‘g = “@ oar 
soyeJsyes yUOINS (GQ’g) NO (eg’9) “(Z°9) SUOTRIAI soy ‘OUOG 


1\ fs Oy 
0 O 


OIIP-B-}S9 0 ‘SOIOZ Sop onb sioje erpUdUOS OU Z x Z 
uolsusup op °y soLgjeul ey ‘W[NouJNg op no uossIog 
op oseuuo][HueYyos sed oyIey sd sjuored sop UOTOITOS BI IS 
2 2p f syuared sourgur xne soyuoredde sed yuos ou gl 
xp €=2 1 T=! Surjud soy ‘] os ve] & SUOIDJOI snou 
snou Ig ‘soyleysyes yuouonbyeuoyne yuos (qg°9) 30 (eg°9) 
‘(L°9) SUOTIIPUOD soy 19 SOIDZ Op dOLeUT oUN so “OY siOje 
‘2 9p sgytun sourgu xne sagiT sed yuos ou |! Jo ! soyron 
xnop Is ‘juonbgsuoo Jeg “Uourayne 9 39 “(9 ep / 9yTUN 
oUIgU eB] op JuRUdAOId 7 BP 3 DIIUN,] B SOI] AIIP-e-1S9,9) 


900Z aiquwiss~ap ‘ajeanbuse.p senbiuyoes | 


,Q ep f gun owigu ke] eB Sogl] xnop soyno} yuos 
0 7 IS oyeuoseIp ev] op onsed oun ms ([ — os /{) ted guuop 
so “Vy op onbidd} yuowisja un “Wp JUoUTaNNY ‘019Z op 
« d9LINOQUIAI »» SIBUN “ATRUOBeIP ojos ouN suTOUT no snd 
2 2NX  N oye ap “°y souyeur-snos onbeyo ‘anno ug 


3 
Be 


BeIp = "Vv 


ou 


SUOAR SNOU ‘JUoSIOTWUAIg *' JQI9\UI.p 
g[qeuea ey op ajuepuodspur oyoy oyyeurjdo oun Issne 
UUOp SOLAVUI oye0 URAYOS seo aT ‘oTqIey} UONestUNdo 
ed onusjqgo suoae snou onb "°%’@ syeurmdo somneu 
eR] Inod soyejsyes yUOS (qg’9) no (eg'9) ‘(L°9) SuoTjIpuos 
SO] IS JULUDJUTEU SUOTJIIOA snou ‘/ yeYNSOI do] JURSTTHN U_ 

‘(100Z) Wore,D 19 d9TTeAR'T onb 
sure “(ZQ0Z) S9]TPAPT “(S66T) YOU 30 uOYey sed snusjqo 
syeynso1 xne puodsaiioo voy Juowonne 9 19 ‘9 Op 
1 gun 39 ,Q ep / gyuN.] aU Ud] UN d}STXo [IS | Og 
yeiasp “0 Op sinavA sop xioyo gf “(,, {)IeA sOURLIVA 
RB] Jostuututu Inod “(sayes9 soytfiqeqoid d9Av UOSsIOg op aseu 
-UOT]HURYDS | OIIP-k-3S9,9) [Nowe op sseuUOTTNULYDE | 
Op o}xoJUOD 9] Sup IP JuoWeNNY “, 9p 7! UN] e 
Sool] , 2 oP SoyTUN.p orquuOU 9] JUoWD[duUIS no} 3s9_ WV NO 


90, ON _ fantom. JONG ee 
I I I 


SUOUD}GO snou ‘saTes9 JOS fu uOIS 
-Snjoul_p sayyiqeqoid say is ‘onb JousITNOs op yUdTAUOD 
PULP ssiiqeq I! tT Pp Just I 
(9°) JuesTpyN 
2 “a4 xneumndo sprod sat suousjgo snou “°°@°’@ 
M'EaF g ‘opeudo someul ev] 9[No[eo OAR soide ‘UU 
{aN do Dy. <1 do Poe ido @ OLN eu RI sind «1 4do ¢ "0 


sINd}99A Soq oINNsUOD mod sasyyn qos 1° saq 
c oon Gal AO Sinn 8,,1=3 eee 
no 
oN a. 1 oy 
( ym 0) ¢ ot Gu 1) _ 14d0 ‘gO 
Nl Int if Tyke 
2 
yu é 
SINDIODA 


So] Jed saguUOp JUOS sINo[eA SoD ‘o[qIey suas ne “(, {)IeA 
yuostumrur mb 4 3do 1g soyeumndo smayea so] jUOUID}O0IIp 
suous}go snou ‘(¢ . op jueyed ueusjepy “57 
op 7 oyun] 8 O9l] 99 & Ino} Uos e INnb *, op 3 gun] 
B JUSWIAINILIDUe ddI] 919 e mb , 9p / 9yun oun e yuour 
-o]duns puodsai0s ([ — al /V) InayeA onbeyo onb suojoN 
",N y[!e} ap yso mb i yu /[)3eIp = =" xed aguuop 
so "y soLneul-snos SBE} ‘sojeuoseip ‘1dr Guos mnb 
"Ow sooleul-snos sof suokenxe snou “y oq +, ap f 


angoyeieo ne GdX-100-ZI oN ‘epeueg onbysneig 


oyun J SUISTIO baat queke (« Syd] » NO) sUdT] op siquioU 
ne [eso EN d0AB ‘ oN a] [Ie) op soured soLneu oun yso “ ’y 
no slic /2/D)8p |= @ [i= ;x/D3e1p] °“@ 
="@'v""@=°V suoae snou ‘[‘guONOes eB op 
UONKSHO}OR} VI SUOIOPISUOD snouU IS ‘([- ‘i /1)3e1p Nay 
Jed oguuop 3s9 ,NX,N oft} op Py sonjeu 
BR] ‘sed 90 SURG ‘UOSSIOg Op No I][nouJag op odeuUOT]HUeYOS 
Jed guuonos[9s jos ,,s uor[yUeyo9,, aonb suosoddng 


UOSSIOg 9p sseuUOTHULYy : [ sjdutexy 


"A Op ouepuodsput oy0} aytyeundo | 39 
a[qrey oyyeurjdo | ms Josodxa .p suouad snou onb a109y} P| 
yuoNsnyI mb sajduroxe xnop jueuduTeW suOjUasoid sNON 


sojduioxo xnoq =S°9 


"/ yeyNsol a] Suep agoUOUd (19) UOTSsoIdx9 | onb Jost 
RB soploey snjd Joisae.s yUoAnod suorssoidxa sao ‘suone 
“tals SOUTRLIOO sueq ¢ 1 os Ll Thy, ie N¢’ 1 4do Fei 1 oy! 4do ¢ 9) 
fodaga Spay 2 De oS gay EO = ODO 


(q8'9) CLIEENG (ON ARSED 


no 


/19do “FD 


14d0 ‘gO , jl 
0" ® 


(eg"9) 9” oN uf id 


SULIOJ PT SNos 
guateanbe uodsey op om109,s ynad (79) uorssosdxa | “OT 'y 
=" onbsind ‘onb sousINos op wWoIAUOD [J 

; oyqrey oyrjeumndo | 
op Imied ev snuajgo @ Sina}o9A soy yUOS Inb (¢’9) sed 
SOQUUOP JOS oO} afeuNdo soLNeUT aN90 ap SOUUOJOD soy 
SUEP JULINSIT SINI[LA SOT ‘JOIOIUL.P oIQuIIVA BT OP A INIA 
np ajuepuodapur ayioy gyyeumjdo oun sua\qo.p jouriod 
mb “°F @ ‘oyusTeambe uodey ap no ““°@ agsrpeut0U 
SudT] op solmeur oun 9jstxo jinb mod soyuesyyns jo 
somessaogu quos ! 97" q = °F gq" Oy suonIpuod soy 


19d0 ‘gp 


 L yey 


: URAINS 
yeyNso1 a] SUOAR Snou ‘juonbgsuOS Jeg “A op sed pusdap 
ou nb (¢'9) UoKNNJOs sw9W eT smofno} UO (p'9) SUOKeNbs 
So] onb suoaes snou sie “(, {)JeA souRLeA ve] op onb 
Isule ‘X op yapuodap ‘y ap smayea saq ‘oVOy syeurndo | 
nuajgo suoAe snou aonb 39 XK ap moyeA ey] wos onb ayjonb 
quan (p'9) onb JoyIEA op oydunts yueuoqureu yso yp“ ° 9 
Sd] Inod samessoopu smMaeA soy suUOp nb (¢°9) onb 
oNe P UdII 4S U (/'9) UONTPUOD eT *7=72 mod ‘onb suo}ON 
‘OOIJLIOA ySd (179) onb suosoddng ‘juesyyns juoWdles9 
So SUOnIPUDD ap  siquiosud 309 onb suonUOWI9d 
‘A@,A uorssoidxo 
mod v (a}stxo ayja puenb) syeurydo soueiea vy] onb JonUOW 


spiod sep eBeved np sasijeiaue6 spoyujew e| ap S}JU@WAPUOJ $87] : JOSJIPU! BBepuOS : da|j/eAe7 }9 AI|IAOG y6L 


angoyejeo ne GqX-100-Z1 .N ‘epeuRD onbnsneig 


suoanod snou ‘(z’9) nesanou op juesTyN uq ‘oyeuoserp 
eins ‘y= "qm 40 o[euoseIp ev] op sioy “qm syuoUWIg|S 
so] JUBUDJUO sOLNLUT eT @ HOS “p= '27'%° 2g onbsind 


1 ca. 

0) — 

EB JCOVGD) Vile 
if 0 D aad 


~ 


1 4do Wg" ay! do Mg 
~ Dowd 


suoud}qo snou 
ge 9 qed (Z°9) op soiquioul xnop soy juerdyynw uq 


OTM = 
egy PM Ha) Hy erat hy 
SIO]B SUDUIa}GO snou ‘(9°9) op dUBT] s1OTUUDId eB] Op 


queueg (py = '%° 9" vy suoae snou ‘atqrey sypeundo 


oun MOAR  JUOUoTIessso9uU SUOASP SnhOU dsUWIUIOD) 


(L'9) 


Sf ete, dO gh) nt) 1 do “gD 7 11D 
Tal = Diinenet 0 V 


. IGG RED ACORTS) PN 11he) 19do‘g9o ,u‘D 
(9'9) Lit= govt 9° °V 


: 138 7 yNO} Mod sayUKAMS SUOTLIAI Sd] MOAR Pp oITeSsId9U 
yso [I ‘soplejsnes yuatos (p'9) suonenbs saz onb mod 
‘seo 90 sued “(24 14,1) , OP 2 SoyuN saqne say sono} 
Mod j= 35 ‘2 9p ,! 9ytun oyne oun mod “T=. "4 bia 
9p 2 gyun oun mod j=’ onb aja} ‘olomonsed 
}OIQUI.pP sqeuea oun Inod soyeysyes ong jonbgsuos 
Jed JUSAIOp 39 XA SIMOJOOA Sot sno} IMod soayIeysnes 
29 JUDATOP SdIOTUJOp Sdd ‘(p'9) SUoeNbe xne suowMo}jol 
snou ‘X op sjuepuodspur syyeumdo osyoy oun mod 
SOJUBSIJNS SUOTIPUOD soy IUD}GO Mog ‘(p'9) suep 1° 9 
SMOJOOA SOP OITSSod9U SUIT vT OUUOP oI[q yI9IUT,p 
gqeuea oun.p A IMo909A np auepusdsput spo} aeuTdO | 
B oulessaogu UOTIPUOD oUN jso sIQIey oy]eUINdO,T 


A ap ayuepuadgpur gyfeudo ay10q "9 


‘(] @ [eda sptod un soak d9UUION}DN|9S 
So 2 9ytuN,] puenb ‘suonjoxd snou onb seo ‘fnes) yHIsod 
yUSUIDJOLS smofno, Juonbgsuoo sed 4sa yo ‘Mm spiod np 
SOULLIPA BP] OO s[quios ’Y moyeordyynur 9] “(¢°9) suosI~HN 
snou Is ‘anno uq +s suoT[HUeYO9 sJaatp Inod sptod [nos 
un.nb snyjd moAeses jnod - 9 Op # 9}TUN,J NO seo soy suep 
SATHISOd yUSTUOJOINS 3sd souKLIeA ayog “%’@ auaTeAMbe 
uosey op ‘no “2@~ sojqissod sagsteuoU suo op 
SOOLLUT Soy sayno} Ins ( gO 21| “)teA JOSILUTUIU B JUDTASI 
Ir onuaygo siqrey uonesmundo.T Q=(,03/| “)sIeA 
Jed gsligjoeied 3sd uOsduWIOY]-ZAIOH{.p IMoyeursa., onb 
SUOJON ‘onbyeid ud JaTNoTVo ap ‘ayqissoduut aMOA ‘oTLOWFZIp 
juswofeigugs yso [Inb ‘75 suep 7 9}UN] 9p UOTSNpoOUT.p 
oiqeqoid ve so ju no ju/[=(,~>7| “)q Yoroms op 
19 [=(M)qZ yeysnes (9°Z) red guuop ‘™ spiod oJ ‘yueAIs 
suas ne g[qiey UonestuNdo oun e puodsa0d yeyNSEI 99 


c6L 


IDO! D 
($9) pene =e 9 
Dey: 
onb 4sd o}eJSVRS IOS (p'9) 
uoyenbs | onb mod oyuesyyns jo oiessoo9u UOTIpuoS oun 
suonbesuoo eg “° Ty? T/T =v, suoae snou {= "97 
"°F gq ouIUIOD JUBUdIUIRYY “oJUeSHJNs UONIpuCD ouUNp 
Issne 113e,S [I,nb auowap ong mned yp! Of" oy) a 0 
sioye suoua}qo snou ‘o]qisioaut yso ” °y onb suosoddns 
snou 19 7 °y'y =! 6" 9y (sorarnonsed sopqeutea sao 
ap sunoevyo Inod oun) SONTESSO99U SUOTIIPUOD so] SUUTOP snou 
BPD (V#,)) gf Pp ,! oyun sayne sal sono} nod Q = “4 
1 {A 9p 4 9HuN oun od [= '¢ onb ayf9} ‘orgtnonsed 
JOINUI.p sqeueA oun mod soagyuWaA oNQ JUdAIOP 
sayjo.nb jso ollessaoou uoNIpuoS oun “JoTNonIed U_ “A 
IN9}O9A Jno} nod saprea 9.49 JWAATOp (pg) SuONeNbe so] 


aiqiey aeundg ¢°9 


‘A Op ojuepusdepul 
C° ae yo) Ee «aeuNdo» uoNNJos sun jUeUUOpP 
a[qrey snyd OULIOJ oun SUOJOYOIOYOOI snou “oyoy syTTeuNdo 
oun .p nary ne ‘ayjonbe] mod 9a]][99 3s UosTeI 9199 “¢°g UOT}DOS 
eR] & JuaUoONdxs snjd eyieredde mb a9 “A JIQeLIeA eT 
ap issne puadap ‘y sop ajquiasua | aonb suoAslasqg ‘onbyeid 
ud oyyn sed ysa,U nb 90 ‘A MdO9A Np JOUIOIOI[dxo [e1gUgs 
ua pusdsp (“°#2@ juonbgsuoo sed yo) '°"2g9 jeumndo 
xIoyo 3 “(p'9) onuoul og] owuwo0og (¢°9) op SOJUTE.NUOD 
SnOs UOeSTUITUTU eT SUepP JURQUD dsURISeT] Op smoyeord 
“Kyu sof JUsyUaspido1 'Y sof Noy ZN “ ‘T=! yo} mod 


1} 


! FT y — dt ido Dot oY ze ie 


gN 


(79) 


yuoysyes mb 
Q SINd}09A Soy Inod sgsTTVOI }SO UONRSTUNTUTU eT 


Pi “ = 7 ynoymod {= '°,' #2 soyutenuod soy snos 


1 4\do ‘go 


aia ee? 


i =O oy! Beid'd & K 


gN gN 


(¢°9) 


JOSHUA 
: NUIOJ BI SNOS dILID9,S 
ynod uonestumdo .p surgqosd a] ‘suonejou sao snog “Oy 
=" onb jo soantsod soryep ‘sonbrygutks yuos ”°y 
sooLeul say onb suojoN “’y op uonnsed oun yuonjNsu0S 
SOUR SOQ «2 YUN.][ SdAv Ud] UN opessod 8 onb 
39 7 QyUN,] 9dAe UDI] UN apessod 3 Is 8 Jo 8 suonIsod 
sot quodnoo0 mb syusurgja xne jyuepuodseri0o °y op 
soLyeul-snos ey “” °y iOS ‘aIWOIAIJIP SULIOJ oUN snos 1110991 
ano ynod suuONUeWsns uonestUMdo.p sowmaqoid a7 
Vv ap 
[nu soedso J suep snout sed jso.u @ ap ynu sdedso-snos 


900Z eiqwisesap ‘ajanbua.p senbiuyoe | 


9] onb no ‘aAntsod aruryap sa (79) UoIssoidxa | Is onbrun 4so 
aq]9 nb yo UONNTOos oun sinofno} 9}STxo [I,nb nuuos ustq 1s9 
II ‘owpnosar ev ayduuts yo onbidAy zosse owapqoid un p yse,s 
[I ‘Soueoul] SoyUTeQUODS sop snos daantsod onbneipenb suoy 
oun .p uoHesiuTUT ey onb one ,p UdT 4s9 U sUa[God 39 
AP OE°V™@A =(,4)28A onbyespenb ourioy ey juesTUU 
“Tun yo “Nv “ “T=2 ynoy mod [= my 6 juesiejsnes 
faN WOE Gc... ct1d0°P9 gy _ MTG youu OU JOANOLY, 

. fe. yueAIns uonestUydo .p 
MUg[qoJd Nv JUSUSU SUOTRIOPISUOD Sod sano} ‘aTquosUy 
‘T=! yp’ @ ‘oquoyeambo uodey op no ‘7 9yn0} Imod 
t= /°L ay suoke snou onb ynej [I ‘steiq sues wos . 9 
® A 9p Jossed mod qdOW PB Op UoHvordde | onb uy 


0 
Dy =! 
0 


SuUOUd}GO snoU “| SIM]eA So] JWRUDIUOS VV O[[Te} Op 
guuojoo anajooa un ' °F sed suoyuasgidor snou Ig ‘smaqIe 
Q) SIng[eA sop yo ‘susUII? {AV INod | smayeA sop jULUD}U09 
>N ffl ap suuojoo moyoa a] ‘°F Hos ‘ougW 9q 


suousigo snou “ “9 ap snu uoU sjusUTgI9 soy yURUDTUOD 
5N_ a[ie} ap ouuojoo “mog0A un ‘99 xed suoquospidex 
snou Is ‘Uuog °,/2 9p # UN] SOA sud] N S9I 
inod sjnu uou syuswiyja sap onb yuonuoo ou ' g maooA 
9] ‘UoronsuoD Teg (ZN OO T=1@ ome eT ap 
guUoJoo ayaa 2 aT |g ‘oUNSUD 4IOGg “JUOtMOATNOQSUOD 
SQOIPUI JUSIOS ,/) Suep ! Oyu | SIOA SUT] Sof ‘7 no} Inod 
‘anb uosey op ./2 & ,/2 OP JRL sual] so] Jossejo suoanod 
snou ‘py[ei9u9s op oylod sues ‘ouog ‘soywiofsip yuos 7 
suonjefndod-snos sa] aonb suojoN *, 2 op / yun] SIOA SUOT] 
oN So] yueuayu0D ,) ep UoHeindod-snos e| ev0) OS 
‘sIeIq sues SUOTRUT]Sa sop asinpoid "°°" @ 
areurndo sorneur vy onb issne suouowe snoy “2 @ moyoxy 
guiarxnoep oy Josmundo ,p iwyns qr (z'¢) ooueneA eT asTuNTUTU 
mb “°2’@ syeumdo someur oun suoyosoyoor snou 
Is quonbosuos seg 2” @ mojory JoMUOId oUQUI 9] WOON 
-yeulgysks ymposd J-9 uONOAs eT B ogIUaSoid UONESTIO}OR] 
ey“ @ s9SI[EULIOU SUdI] op SOLYeUI 9]N0} Mog 
ey" @ = °y no 


(79) 


AT OV" OA = (DCA 


SUOUd}GO snoU ‘][*9 UOTDAS BT B IdJUOSOId UOTSTIO}OR] L] 
reg ““” @ oesITeUIOU sUdT] op soLeUr ey] eB yodde: sed (7'¢) 


onsojeeo ne GqX-100-ZI oN ‘epeued onbysneis 


OURLIVA PR] JOSIUUTUTU & d}SISUOD IOI UTWUeXS syTeUINdO _p 
sug{qojd 9f “ney snjd suUOTUSU sUOAR | SnOU sod 


aulg{qoid np gou0ug : 93.10; gyTTeUINdG = 79 


9 19 “@ SOOLYCU XNOP UD S9SLIOJOR] 
ang smofnoy nod {9 & ,Q JueYoI *@ sgsTeULIOU 
SUI] OP SOLNCUT kT ‘UOTON.NSUOD 97390 JURSTTNN Ud ‘oUDG 


(19) be 
LC” @1)8e1p]” @ = 
Co DseIp]*°@°" @ = 

Me’ @= “ee 


fe) 
I 


q0 
LC @psep]”°e@ 
= ®@ ‘uonbgsuoo red ‘yo “(@"D)seIp =(MO°DseIP 
suUOAR snoN ““?@ op med e onudjgo dasiTeuUOU sual] 
op compe ey [CP @{DseIp]@ = @ NOS ‘¢°¢ UONDES 
eR] @ gquesoid « soddeis sop Inougui. e@ un mod sno}» 
S¥O 9] JULI9 ALULUOD SIEPISUOD ON JUotITesa nod |] “(7 
op 8 SUN So] OIIP-k-}sa,9) syuoUIgTA sun] op Ired e (7 
op 7 soyun soy omp-e-3so.9) soddvis op oseuuol[yueyos 
UN SUIWOS dIEpIsUOD ag ynod 9}xQ}U0D 990 sURP JOOIIPUT 
asepuos 9] aonb suojoN ° gQ Pp 2 gin oun jJuota}oRxe 
B 99] 189, Op 8 oyun onbeyo ‘4 uonejndod 
eB] op voNTUyep ve] QUUOpP JuRIY ‘yNs sWWOD , Nx WN 
ayia op “@@ sual] op somjeu ey omMmsuoo suoAnod 
snou ‘7 ® ,/ 9p jeje oydess a] suOIgpIsuOd snoU Ig 


“sjueyuo 
-sjuored suoneindod sop uonesti0jovj eB] op yeI[Nsey *7 WANS 


1 8 8 i 


spiod sep ebeved np sasijeiaue6 aspoyujew e| ap SJU@WAaPUO} $87] : JOSUIPU! BBEpuUOS : da||/eAe7 }9 AIIIANG Z6L 


onsojejeo ne qqX-[00-Z1 .N ‘epeueD snbnsneisg 


‘7 OINSIF Vy Jed SUUOP IOS UONLSLIOJOV] 9}}99 Op JLINSOI 9] 
‘syuRyUd sop jo syuored sop o[duI9X9 | op sed oJ sue “(7007 
IT[VAVT IIOA) JonIqey uosdwoOY]-ZWAIOH{.p INoeUINSd | 
® ddOW & Wnoge yey jo adh) saddeis ua asvpuos 
UN He} Ud qSd_,/ B ,,/) OP Popul osepuos aT “7'¢ UONeS 
eB] & oaquasaid « soddeis say suep sno} mod un» uonenqis 
eT eB puodsau0s eagQ “°’@=°'@ onb ‘ouop 49 ,/A 
op / gun oun ve ‘snjd ne ‘ogl] iso, 9p 8 gyruN onbeyo 
‘uorjonysuos sed ‘onb suojoN “JusWeNNe (~ = 0 pon 
op 3 gyuny sioA ,Q 9p f gun] op Jueped (« aYyoe]f » 
oun no) Uo un ostxo [LS T= ,.6 no ‘[,9l=°"@ 
MOAes ¥ ‘sIeIq op soUasqe,| JuRINsSsSe ,NX,N 9dIfTe} 
ap °’@ sudl] op solneur oynes oun.nb oqstxo,u [I ‘oydeis 
90 op jueyeg *, ep / gun oun.p jueped « sysop » oun p 
SIUID}XO | JUL} sUILUOD agstTenjydsou0s ang yned ,/ OP 
8 oyun onbeyd ‘9 & amMotiodns yso Moyea ev] Uop *”@ ap 
v6 SJUSUIZIA.P S1qUIOU 9] Jed aguUUOP sIOTe 1So NV VON] 
-ndod vy op ote} eT +, ep / soytun sop jueyed sual] op 
e A [inb soyun .p jurjne yuRUaUO yg uonendod aun j10s 
"JINS [I DUILUOD s[vIOUNS So UOSe} OP UOTENAIS 99199 OILIDOp 
suoAnod snoN “¢°¢ 38 7¢ Suooes xne sgyuasoid (9 
® A ep) « (soddeis sop morigjut| %) Un mod sno} » jo 
(,2 ® ,f Pp) « (seddess sap morigqut,| &) sno} mod un » 
SO}]XOJUOD Sd] SUP dOST[LI 1S9 UOTeSLIO}OeJ v] nb yo soddeis 
ap sguLIof js9 ,/) uoNendod ef onb suorsgpisuoD 

.do'gy © 
ayeurndo s9sijeuIOU SUdIT Op SOLQRU oUN.pP dYdIOYOOI 
BI JWoUIsTqeiopisuod oyyduis so1sexa 9D ~~“ E@””’@ 
="@ onb soya @@ 10 °”@ soostfeuLIOU suo op 
SOOLN UL sop pe 4) uonendod oun sJoanon e QSISUOD dI[q 
“SIANISUL] BP] IP ISIOAUI DUATQOId 9] 3S9 UOTJESLIOJOR] VT] 


UOHSIIOVIVA "9 


‘ddOW FB] Op ouyeumndo | ms s}e)~nso1 xneoAnou 
ap suojwuossid snou ‘uoNd9s 909 sued ‘suOne[NUIIS 
sop Jed omues suIOU Np s}eyNsaI sap nudjqo WO ([(Q0Z) 
uoleD 30 dOTTPART 19 (ZOOZ) SATJeAPT ‘O= “0 onbs.10] 
OF 140‘qv9 PIMOS oO enbsio] [= sibeg0 JosTjnn Welyey 
[I.nb njouos yuo si] ‘ayesa ayyiqeqoid saAe oseuUOT[HURYDS 
Jed nuajgo jso Ss nO ZT=,N NO s9ytfduis uoyenps 
eR] Inod sj}eyNso1 sap nus}go yO sTT ‘ayyeurNdo .p ouratqoid 
90 JOUTUIeXd & SIOTUOId Say 919 JO (S661) JOU 30 UOYey 

‘stogad snjd ay X 
Op Mo}eUIYSd | 11U9}go Inod o:pusid yuateslAap () onb spuvis 
snyd ae S}UDUZ]O Soy onb smoyea soy] JOANO SUOTIOUIIE 
snou ‘Jip juoweyny ‘oyeuuM pos ~{ IMoyeuryso | 
ap souruea ey onb aya “°2’@ osommem oun sulow 
Ne JOISIXO WeIAp [I ‘ooLNeUT 9y}99 op puodsp smoyeurlyso 
399 Op (Z'¢) DoURLIRA eT onb suUOp jue} ‘S9sITeUIOU 
sudI] op corneum oun wos “”@ soINeU PT anb UOT}IPUOD 
RB SIeIg SUBS SUOTRUSd Sop \LMO} spoy}su 99399 Jed nusa}go 


L6L 


7A Moyeunyjso,| “¢ yeyNsg1 Ne eYUOUT SUOAR | SNOU sUUTUO_D 
‘'ddOW 8] Oop yueyodun jyoodse un jso oyyeundo,7 


aeundg ‘9 


"A [2101 9] Inod gsterq }sa IMoyeUIsd 420 
‘A=K'1L4#'AOL=(, I ‘Teipug3 uanbsmg “A op 
syuowg[9 siotuioId A So] Soide.p ym.ysuod ImajooA-snos 
= aac Ne Paiant Sune aly Qype oN UE My is 
suous}qo snou ‘AQ Op Noy ne AA JrRsIyN us jo 
(p'Z) op weueg No" ‘T=f mod 9="9 wonuos “”@ 
sjonbsaj nod , 7 2]qQI0 uonelndod ev op 7 sgqrun soy nod 
s[nu yuos spiod soy ‘(g°¢) UoIssaidxd | OUOU 9] SUUIOD 


(3's) =M 


’ 0 
"TW Le 
: splod ap “AA SUUOTOD 9}00A 
9] 41u9}go suoAnod snou ‘(9'Z) uonenbs | ap jueyeg ‘[9‘'@] 
= [(“@"D2ep] “@="@ aueAms ooseuOU soy 
Op SoLNeUl eB] SUOAR Snou ‘agstjeIoUs QSIOAUI 91190 DOAYW 


(L's) F IC” @'1)seIp] 


10 0 

0 [Co DseIp] 

3S9 (9°S) Op d[QISsod dgsI[VISUIS OSIOAUI OU) ‘(TL6] 1e9S) 
V=V_VV onb uonlpuoo e& W op s9si[eioues osIOAUT oun 
ySo _Y SOLjeul ey “W SOUUOp s9LIed SOLQeU oUN Inod ‘anb 
suojaddey ‘ouajqoid 99 ap UOTINJOS sUIWOD aasijD1aUas 
ASAJAUI SUN JOST HN ,p s[qissod o9-jnod jrelas TT “sed a)STxo U 
LC’ @DseIp] “Sosinsuis ysa sonyeut oy00 onbsing 


au) 0 0 we 
soni tT; ee rf 


(oto 71) sep] = [Co Dserp] 


anb JUSWId}DOIIP 9TNOSEp JI UOTTUIZSp 99399 9q 
‘To ‘@]= 7” @ quonbgsuoo 
red suoae snoN *,N “" ‘T= mod Q= “9 yo V@ 
ap souuojoo sonne ,,AV say anb suosoddng ‘ajuapgogid 
UOONS I Op sajao op sawuolayip ‘'@ soLeUI-snos 
eB] yuoWIO; soyanb suosoddns jo ‘9<“Q un sulow 
ne yuonuos “ @ sudT] ap soLNeUI eB] Op SoUUOTOD soJoTUOId 
aN sep sunoeyo onb suosoddns ‘ajjaurzoj snyd uses oq 
"A 210} Np gstergq InoyeuITyso uN 
e qua Inb 990 ‘UOT}IPUOD 99399 sed }IRJsHRs dU adnd90 snou 
mb seo 9] ‘SUOLIOA 9] snou otUtUOD ‘aysIxo | ( @" 1) 3eIp 
onb yey [I ‘oruyop uatq wos “’@ soLneur ey onb mod 
‘anb suojeddey +, 921q10 uonendod eR] op oyun ounone 
B sagioosse Juos ou 7 UOHRINdod ev ap sgyTUN soUTe}II0 
onb o1usIs vjag ‘soloz sop onb yuouuanuoo ou 7” @ 
SUSI] OP SOLYLUI RI IP SOUUOTOS souTeyIIN onb suosoddng 


9STBIG AMIJVWUIHNSY CS 


900Z eiquiadep ‘ajenbue.p senbiuyoo] 


‘OW Re A's = ,4 ea suoud}qo snou 
(0) ap aed Y aie “1=1 mod 0< “9 un sutow ne 
yuo mb , 9p sgyun sap | ‘u uonss|gs op saiiqeqoid sop 
quowuonbrun juspusdsp spiod sg] ‘(¢°¢) oUOUL 9] SUTUTOD 
9) eT Le 
"TW LL0 1] = A 

sJoye Suoud}qo ey. NX oh 
gy[ie} op sjeuoseip comjeur ey ({") gs Rs yi} )8eIp = ", 
}10s ud op ty Ne N oqyre} ap arog ely dole 
By (tu oo as) seip= "TT wos “TW LL0 ,@]= 
sptlod op dUUO]OS M9}09A J] SUOUd}qQO snou ‘(g°Z) UONeNb9s | 
ap queued *,,N d[[le} op | op suUOJOo MajoaA gj Js9 "'T No 


( . ) 0 beg 0 eh TK 
aes 'a| | [('o”1)zep]'e| ® 


suoud}qo snou ‘ye}]NSoI JoTUdId owTUIOD 


SUOAR 
snou ‘juonbgsuoo Jeg *,N “* [=1 mod 0= Herve ee 
op sousy] sayne ,, AV sey aonb SOS DUSNS! 4 '@ 9s0LNeUI-snos 
RB] JWOULIOF saqfo, aD 1» (O< “9 UN smoW ne WoNUOS 
@ sudl] op soLyeu ev] op sous sosonuoid , N sop 
sunoevyo onb suosoddns ‘ayjousoy snjd uodey oq ‘oseuuO]N 
-ueYyod | Op onA op yulod np soVdJouT SUTUIOD sIOpISUCD 
ang ynod nb 90 ‘7 ep 9yUN oUNONe JoyHUOpI.p joy 
-joultad ou Solfo “8 UOTTHULYOS,| SULP sagUTIOTDE]9S JUOS 
soqTuN sayfa} 9p Is ‘sIoTY *, Q uoHe[Ndod vy op gun ouNone 
B sagioosse Juos ou ,/) UOHendod ve op s9yTUN soUTe}IE0 
onb ousis vjog ‘soloz sop onb yuouusnuos ou ”@ 
SUSI] Op dolNeU eB] Op sousT] souteyad onb suosoddng 


JdVIYJOUl osvuuOTHUeYIY p's 


vy i Mer N ee Ke 
suoua}go snou “(p'z) ap ueueg «yo P=A yen Va A 
SOUUSAOU SINITVA ST JO AA DUUOTOD tat np (2 10) 
A syusuig[e sat ‘ouog °(, Bef TS NU ul ty He 
yN/1) =,AX Spiod sop QUO [09 INDIA 3] suouajgo 


snou “(9'7) sodeq “({7TyN/1 "LN /1})3eIp 

="@ suove snou ‘Uorssoidxo ooo juesTyn ug 

("qo ah) Zep = 2" @ omo9 Issne suoAnod snoN 
ie A ea el 

(¢s) slic esata lin ol) a\cag 


onsojeyeo ne Gq@X-100-ZI .N ‘epeurg onbysyeis 


JUL}9 SUTLUOD dTUTZap sIOTe iS i @ suoly 

"y SOLHVU BT |] Sop Juotonbrun yueUdyUOD jo A Qyyrea op 

‘YT QUUOJOD M9}99A dg] JOS “oUUOJOS dynes ouN,nb JuaNUOS 

oU SOLNeU-snos onbeyo no soojq Jed o[euoseIp sWO} op 
1’ @ sudl] op soLNeU ouN e& puodsaLIOD UONENIIS aN09 

'7N = J onb tssne suojon 5 Al 

op 7 sgyun soy onb isure , ap soddess say mod 4 ano] 

eB] Josiqyn suoanod snou ‘juonbgsuos seg *, (7 ep 7 gyrun 

oun JUoUA}OeXA & agIdOsse jso_,/) Op A oddeis onbeyo onb 

Saq]o} Juos saddeis sag ay ay[le} op ounoeyo ‘A soaddeis 
J Uo d9SIAIp }sd_, Q UOHEINdod ze No seo a] SUOIgpIsUOD 


(soddeas sap moii9}UI,[ 8) un nod snoy, ¢"s 


af 
Sy a ae 
pi 


iS 
gX 20 


(7's) ah 


suoud}go es y Z) ep eyed *, 9p A addess onbeyo 
suep sogigdgi aa is “) SINO[VA So] JO AA SUUOJOS .m9}99A 
np sjuourg|9 S91 ‘OA 9] SuOANOd snou suTIOD “(TJ / 7 
oe TST u/ 4) =,AN—Splod = ap auOJOo=—Ma}O9A 
a] suoua}qo snou “(9°Z) uonenbs | op med vy ““” @="@ 
ouop yo ({12p 4} )Berp = (C41 “8 1} Burp" sep 
= (7 @"1)8eIp suoAe snou ‘uoTssoidxo aye0 JURSTTON ug 


“({47] “> 27} )8e1p = “"@ omI09 Issne suoanod snon 
i weeds on 

(T's) ‘by: Oletenet ci LemaatO) ulna 
Gry 7 MT 


JUL}D OUIUIOD oTUTJOp ssoTe yso % /0 sudT] 
op soLneul ey] “[ Sop yuouonbrun jueUdUOS 49 aN oyyrey 
ap ‘“y ousiy moa}00A 9] WOS ‘UST o[Nos oun nb JUdTJUOD 
ou soLyeul-snos onbeyos no soojq sed oeuoseIp sUOy 
op 7” @ suodl] op soLneur oun ev puodsaiod UOHENIIS 37399 

',N = J onb tssne suojon *, 2 2p 
soddeis soy] mod onb tsure , 9 ap / sgytun say od A ajo] 
e] Jost suoanod snou ‘uanbgsuoo Jeg *, 9p / gyun 
oUN JUSTHO}DeXO & O9TOOSSE Sd _, (7 ep A oddess onbeyo onb 
SoqJo} Jos saddeis say ° aN oy]re} op ounoeyo ‘ A soddessd 
J ua ogsiAlp iso, uoNendod ey no svo a] suoIgpIsuoD) 


(soddveas sap moii9jur.| &) sno} mnoduq 7s 


ALU L'T 
= ,4 uosdwoy]-ZuAJOH,p Imoyeumsay onb one 
1s9,U (¢°Z) sed QuUOp ,X IMoyeUINSA,| ‘UNG “A= AO 
=7Z issne suoae snou jo ("yus"y oo" uy N= MM 
Jed guuop jso (9°Z) splod op moda 9] Gnenbsst0 
rq I= *"@ suoae snou 4yeyINsgI Jord swUOD 


spiod sep ebeved np sesijeiaue6 apoyjew e| ap S}JU@WAapPUO} $e] : JOOJIPU| BBeEpuOS : da|jeAe7 JO AIIIAOG O6L 


ansojejeo ne FqX-[00-ZI .N ‘epeueD onbuysnyeig 


‘NX N 9[Fe1 9p so J Sy WUSpT sole ej onbya AY = ~N 
=,N onb onbrydum vjoo uowroyfomenN “aatjoofiq yso 
gf a1q19 uonendod yy 32 , 7 voHendod ev] anua uoHRe 
ve] onb oyusis vjoo ‘onbneid uq “J QNUOpI sOLNeW eT 
Jed sguuop ios *”@ sual] op soLneu ev] aonb suosoddng 


gual ALR 1S 


‘(p'Z) noyeuNsa | IMs sudT] op 
SOLYRUL RT Op JOJJo,] WWoNsn]! spt sreu ‘onbyeid us soarosqo 
sed JUoJas au sed soo sno} aonb afqeqoid 4so ]] ‘sowlenxo 
seo sop e juapuodsaios nb *” @ sayetoeds sual] ap soomjeul 
SOUTRIIOD SUOALIO9P snou ‘UOKNOES qUasoId eT VY ‘ddOW 
py red aguuop (p'Z) Md} eUIT}Sd | IP SWLOJ VI 9}9IP a ’@ suoly 
ap SoLNeU eT ‘sayUapaooid SUOT}IDOS SO] I.UOU 9] SUTLUOD 


sayersods SUI] IP SVILVBYA..°S 


‘(9 UOT|DS BJ MOA) oyeudo onbyst9}oK1e9 
oun ‘suas ureyI90 un suep 4ueke ”@ soLeUI UN ossejO 
91109 sUepP IIsIOYyd & 19I19}UI UTeVIN0 UN oUOp kv A I] ‘asseyO 
91300 ap Juowenbrun puadesp 7 ua uosdwoy]-ZAIoH Pp 
Iayeurnsa | “yuonbesuoo seg ““”y un-ol9z sudT] op soLyeUl 
PR] Op dI0A ev] Jed sousTeAmnba.p assvjo ev] op onbystigjovse9 
gun joni jsa stew UoKoUO; ve] yURsstUyop 7” @ orOTTNOHTed 
sud] op somjeul ey op sed puodop ou pt ‘f sed ypu 
yso urd 9] oumI0D (8), V9 PZ = (3%) d wed A 
ns oseuuo]]Hueyog .p ued un yinpur f/ uonouoy eT “(7 
ap safquusasud-snos op sjquiesua., Ins ayyIqeqoid ap 10] 
9UN aIIp-e-}S9,9) ,/) Ins aseuUOTHULYOE,p uejd un ,d jos 
‘apuojoid snjd ayordoid oun B sagtoosse ‘sudIT op soolyeUr 
So] oUa sOUDTRAINbE,p UONRIONI oUN OUUOP snou PI9 

‘) UONOUO} eT JUOUTESIO9Id JUTJSp nb 
‘NX ,N eqtterep [ hs) = "ry un-osaz sual] ap aout &} 
WUYIP gp] Op squissuay 9 (sor =(,5)> uormp 
Holidold ev] op nyJOA U_ ‘JUSWTOQNe ¢ 19 ‘C s)d e yuonredde 
gf *P 2, SM IS T= ql YOS ‘gf suep apqniest 
un yso (8) ‘sioty *,Q suep / gyun oun mod {/}= ,s 
suousid : jms ]I oWUWIOD JaQUOWISp so] suoANod snon 


: UONRASUOUIIG 


‘UN-OAIZ SUAI] AP AILAJOUL 
oun red onboambs sues s9urusojyap jso  UONOUOJ eT 


: 9 yeINSIY 


c G I CfAG 
aera Sai POU a tens 0 EL 
y pry TUNLDs yi) et 
@ onb suosoddns ‘/ oumuop °,/ 9p sofquiosua-snos 
op squiasua,| SIA , /) AP Sa[quUasUd-snos 9p s]qUIASUA | 
op juvyred  uoljOUOJ oUN sUUOp snou UO nb suosoddng 


681 


GQ ,N 
JURI[OI SydeIs Np SOUDPIOUI.P SOLNLUI BI Op SJUSUIOTO sop 
138 S |] ‘JUoWAQNe ~ 19 ‘“O< “0 Is [= ait WOS “O< cat 
soak (1 ‘f) sojdnod op sajquiosua., sed onbrun uodsey 
op s9UIUIa}9p ISO Vy UOTHULYOE,| 39,8 UOTTHULYDE | 
ous souepuodssnioo ey wque mb jW< si f 
uojouojy oun ‘ouoqd ‘{0< #6 pe ,S2lE| ,NPB= Ww 
yuouIgtMOU ‘7 SUeP 7) UOT[HUeYO9 UN ,/? SULP ,S 
uoy[WURYyoS onbeyo kv a100Sse yOOMpUI oseUUOT[HURYDE TJ 

‘yuoAIns mnb 
soydeiseied sa] suep uonou 9999 suoddoyaAgp sNnON ‘ddOW 
eR] red syinpoid (mMoyeurysd | oUOp 39) splod say sup oyoI uN 
jusnof 6 Sop SINIVA Soy ‘sme Jeg ‘aseuUOT[HURYDE .p 
snssoooid a] doAe sed JUOIOJIOJUI,U soyIpP yuoWoIdosd 0 
Sop SM9[VA So] ‘UOU No say[NU aNg.p Wey 9] 9NNO 7 19 
,Q suonefndod xnap sa] aqua sual] sop yuourenbrun pusdap 
oseuUOT[HULYSS Pp snssad01d sa] ‘OoNpPUT OsepUOS Np sed do] 
suep ‘onb j1e} a] INs suOjsIsUI shou ‘UONdeEs oJUEsgId e] VW 


dd DW B®] 9p apfeANjon.ys 93911do1d suqQ,*p 


ea” @ # 7" @ NO sojduoxa 
Sop ommpoid op splovy JUSWOANIOI 4sSo [I Wey u_ ‘[Te1QUNS 
Ud SdIFLIDA Sed jS9_U (Q°¢) UONIPUOD eR] “UOWOSNomMoUTe/| 


(9’¢) Ee” @= mac) 


TS JUSUOTNAS Jo IS SAISUB] jSO 5 re) 
® 2 ep sind “7 & , oP ddOW 2 op uonvorydde J 


: ¢ yeyNSQY 


: JUVAINS Je][NSOI B] SUOUD}GO snoU ‘(/¢) 
19 (¢€'¢) Suonenbs say jueredwios ug ‘(¢°¢) red sguUOp ° AA 
sptod say onb sourgul say JUaUIA}OexXO oO JUoTeIAOp (7'¢) Jed 
souuop °AA Splod so] ‘oanIsuey yUoUoyIEpIed yos GOW PI 
onb mod queusyureyy “qdOW ek] suep ?7@*" @ degsTTeULIOU 
SUOT] Op SOLNeUT eT JWeSTNN UO odeo anos ouN UA snUD\Go 
ang quoaned 44 spiod sa] 4Ip jUoWoNNYy ‘suds UTeLIO0 
un suep sulour np ‘santsuen 4so gqOW Fk] ‘Juonbegsuoo 
Jeg ‘O9SI[eULIOU sUdT] op soLyeUI uN yso °° @”" @ sOLNLUT LT 
“[ yeynsgu a] soude.p y= *1°%@ = "1% @%@ onbsing 


(L'€) "TnL @“%@= 
TCT COL @)8eIp 7 @ = PAA 

suoud}qo 
snou ‘(9'¢) uonenbs | suep (p'¢) red 7Aq Juededuios uq 


(9'¢) ““T(7ay) 3eIp °4@ = °AA 

suoud}qo snou ‘juonbgsuos Jeg “(744 )3eIp = (74 )BeIp 7L, 
suoae snou ‘,77%1 mod g= a say So] SUUIOD 
qJuowonne 9 ‘727 IS T= we (9 °° “= 
sone (%3)3eip=*p 1 | [(°%@ {sep |°7@= 77@ nO 


900Z eiqwaesvap ‘ajenbua.p senbiuyoo | 


(S'¢) “T( 7M) 8eIp “L -%@ = PAA 


: syUBAINS sptod sa] ytnposd 
5 291 uonendod ee {cy s[quiasud | ap JURTTe JOONpUT 
asepuos np 9}xo}U0D oT SULP qqOIW ve Op uonvordde | 
‘2 Iq! uonefndod ee ,.s UOT HULYD9 | Op yuRT[e JOoMpUT 
aseUuUOT[HULYOY | OAL OILIV[TWUIS Ieq “{~j) s[quiosua,| 
Joyuapt mod yoompur osepuos ap snssodoid un suep 
soesiyqyn yuos inb soyrun.p uoT]WURYDE UN SUTUOD dISpIsUOD 
ane nod {ey s[quiesus| “IQ “,“ ynu uoU splod un 
SIO[e SUOAR shou *,7j 9[QuIAsUd,| 9p 7 9}TUN onbeyd Ino 
TL = 7M 
> gQ vonendod ey ap spyrun 
xne so1oosse spiod ap 744 UUO]OD M9}99A 9] SUOUD}qQO snou 
(9°?) op queued “{0< {66 P ,OPFIE|,N>¥% = 50 
d[quIdSUD,| SJO[e SUOAR SNON “0 < 576 Soyfonbso] mod op 
-B-]S9,9 ‘oy[nu sed jsa.U souvpuodsa0d ve] soyfonbsay smod 
5f2 P ¥ soytuN sey sio[e suOHUAp! snou ‘75 s[quIesua | 
op 7 oyun onbeyo mog ‘{0< bea ee het ee 
=,0 suore snou ‘ueaviedne owu0jd ~< 6 
soqjonbsa] nod omp-e-3sa 9 “oyynu sed jso,u souepuodsa05 
eB] soyjanbsay nod , ep / sgytuN soy suoyHUep! snou 
“8 Suep oguuorpefes / gytun onbeyo og ‘sodej9 xnop us 
JOIIPUL ISepUOS Np UOTIESITHN | JULUDJUTeU SUOIOpPISUOD 
‘IC @"Dsep] °"@ = °"@ no 
"TLL = °M 
: SyUBAINS spIod say “(9°Z) soide .p ‘suoud}qo 
snou “qdOW &| juenbydde ug +, 9]q10 uoHeIndod ey] op 
med e “4 y919UI.p d[QeLIvA eB] SUOINSOU SNON “{0 < a0 1) 
yS2/E|,02 Y= {0 eWqQuwWesus,| 3uA\Go mod ‘9 < za 
sojonbsay mod omp-e-3sa 9 ‘ayynu sed yso,u sourpuodsa109 
e] sayjanbsay mod .f op ¥ soy soy suoynuepI 
snou ‘8 suep sguuonogias / 9y1un onbeyo nog 7%" @ 
="@ wd iNx,N oe op [o]=-"@ suoy op 
SOLU PT MUEp ve WoIAeT , 7 e sind ‘7 & ,Q UoHRndod 
RB] Op Jasseg “4/7 9/qQI0 uoHE[Ndod ey e juoWIA}ONpP ,/) OP 
JURE JOOIIPUL ISepUOS 9] SUOJOPISUOD “IOOUDUUIOD Mog 
£502 8% ,f Pp eMemp uoneorydde uos e 
ayje-jneainbe 5 & , op sind *,7 & , 2P ddOW F&I °P 
uoneordde | 4p juswoanny ‘sanIsuey ySUIITeS9 1S9 GOW 
PR] ‘oMAnIsuey Jed yoMpUl osepuos np 9}Xx9}U09 a] SUP 
sonbijdde jso ayja,nbsio] “IS OARS ap d][99 sd oyUR}IOdUIT 
uonsenb ouq) *,/7 ep sed v sogmsout o.j9 JURASP sgyTUN Pp 
{0< 599 ® gU37E| 523 Y= {0 eQWosUe | JOULIOJ op 
uye ‘sagioosse Juos A nb ,/) ep sgqUN sa] SIo[e SUOTJTJUOpI 
snou * 7} s]quosud joo op INIed VW ° 1 OP {Vv eQuIOSUA,| 
Joyuapt red suosuouruoo jo, uonendod ex op med e 
,S UOT[HULYDS UN SUOUUONOII9S SNOU “BJ9O INO, ‘APlAlpISUD 
Jed JOoIIpUl IdepUOS 9d] JOsITyN JURUd}UTeUT sUOANOd snoN 


(p'¢) 


(€'¢) 


ansojejeo ne GdX-[00-ZI N ‘epeueg onbysyeisg 


‘soyun xnap So] 3.QUd UAT] 
uNoNe 9}SIX9,U [I ‘UOUIS ‘9 < ,f onb uonIpuoo ek ,/ =p ¥ 
SuUN,| B O9TJO14S9 5) OP F SUN] ‘Wp youonny “0 < {66 
juoulg[g enbeyo no ‘Vx ,N aie op [yel=°"0 
sudl] op oomjeut ey sed agyuesgider ong ynod 4 30 
7 suoyetndod xnap soq aus souepuodsalion wT *¥ 99}0U 
sunoeyo ‘stun {Ay yoHUOD ./) 9]qQID UoNe[ndod ev anb 
suosoddns snoN °, uonefndod ej op ostuaqua.| red onb 
erpuloye jnod ou uo. onb 5/9 9qQId uoKeyndod oun smod 
SUOTCUIT}SA Sop oiINposd suoT;NoA snou anb suosoddns 


PMADISUCIL oC 
(766) ULUNOI AA 10 UOSSUBMS ‘TepuRS JOA ‘uosdwoy, | 


-Z\IAIOH{ Pp INIyeUINSd,| xp soueLIeA eT Op aAnoid oun Nog 
9’ y" @ = 17 no 40 i 

suep f jo f sgqrun sop oyuIofuos UONSIIEIs Op syTTIGeqoid 

PR] ISO ee no 79 LN X,N ole op sAneSou UOU sTUIJSp 


Semeur Our eass 7 a[ a seaboard 


A°V,A= 
Z'V,Z=(, dA 
Jed aguuop jso_, { op SOURLIvA BT 
: p JeINSIY 


(Z'€) 


: JUBAINS JeI[NSOI 9] JUSWID}aIIpP suoUd}qoO snou ‘UosduwOY J, 
-Z}IAIO}{ Pp IMayeuyjsa un ysa ‘(¢°Z) IMayeuIsa | SUTUIOD 


VUBLIvA ZE 


‘O9ST[LULIOU SUDIT Op SoLNeUI 
oun yso “”@ “uonbesuoo sed yo “f= "7" @ MoOAe suoAdp 
snou ‘(]"¢) soide.q ““T=(M)q7 onb suosoddns ‘UBUDUTLI\| 
‘sIvIq sues oUOp jyuOS suOTyeUNSD so] 10 7T=(M)T 
yUUID}NNNMp suous}gO snou ‘| yeINSeI oy, JURSTWN ug 


(1'¢) “TT @=(M)F 


SUOAR SnoU ‘(9°Z) op JuRLIeEg 


: UOH.ASUOWIIG 


‘SOST[LULIOU SUDT] Op SOLyeUT 
sun so “ @ OLNeUT J IS JUSUOTNAS Jo Is SIeIg SUBS SUOTIRUT 
-1So Sop WuIMo}J (9°Z) Jed gUUOP AA Splod op mo}90A JT 


: € JEIMSIY 


: JUBAINS Je]NSOI 
9] I1ud}g0 Issne suoAnod snou “UOTssNdsIp 99399 Op jURLIeg 
"sTeIg SUBS SUOTIEUTSO Sop yNpod FqHW eI ‘uonbasuoo 
Jed 49 apleJsyes JUSUID}SOIIP }S9 UOHIPUOS 93390 “UOsduOY L, 
-ZIAIOP{ .P IMdyeuNsa un jso (¢°Z) IM9}euIsa | onbsmnd ‘uony 
-onysuos Jeg ““T =(AA) WZ onb qWyns II ‘steiq sues moyeurNsa 
un muajgo mod ‘(6g6]) ISUIq QUUOTUSU ev] SUIOD 


sIviq op auasqy = ['€ 
dd DW BI ep saygtidoig = °¢ 


spiod sap abeved np sasijeiaue6 apoujew e} ap S}UsWAaPUOJ S97] : JOSUIPU] BBEpuOS : aaijeAe7 32 AIIIAOG 991 


ondojejeo ne GqX-100-ZI .N ‘epeueD snbysneis 


(ZOOT) S9TTPALT HEP 
fo) io) 08188070) ‘ddOW eB] red snuajqo JOS mM9}09A 90 ap ‘mM 


splod soy “/u/ ..9, B ce ‘™ suoae snou ‘,N “" “[=1 
onbeyo mod ‘a ,N fle ap 3so AA MOOVA OT 
(9°27) TO LO = M 

: splod 
9p AA SUUOTOO m9}99A 9] IUap oUOp suoAnod snou 49 
ATOLL =, suoae snou ‘K*"@=7 onbsing 


($2) TW L'= 4 
J Mo}99A Np UOTOUOJ US UOSdwOY |, 
-Z\AIOF{ Pp IMoyeurjsay yoursjoop JowUoy suoAnod 
snou °Z"T= A @'L= ,A op ued ug +/7 sooLeorput 
So[qelivA soy jJueudJU0D ,NX,N 9[fie} op ojeuoserp 
SOLQeUl Aa (,))8eIp = ’L Wog ‘yuowonne 9 49 nSoe 
Is T=, 7 no AO “ U}= 3 OS JuowomuepMWig +s 
noynaeqos, 1 op ofem) 3] Inod sagsT]yN UONd]9s op sazTIq 
~eqoid say yueuayuoo , Nx ,N oe ap sjeuoseIp soLyeul 
el (,2)seIp =" II Os jo , yu ae ‘yu} = =," 0g 
"JMS [I OUTWUOD STUTJEp Sd 
mb “qdDOW B®] & ANode1 ap ssoye asodoud I] ‘ayypIqeqoid 300 
Jgqnoyed op ‘oyqissoduut on0A ‘aploygip ane yned I ‘oomput 
osepuos NP sed 9] suLP “(Z0OZ) S9TTBAP'T 19 (S66) S9TTBAPT 
QUUOHUSU 9] SUIIOD / SHUN, 9p {1% UONOII9S op dIITIq 
-eqold ev] Op dSIOAUI.] splod owtu0d JosI[yN.p yWyNs I ‘x 


qd 
Op sIeIq sues UORUISS OUN ITUD\}Qo mod JuowsTemiqey 


(72) “AM = gh 


ULIOJ VT SNOS HLIOVEI a.NO ynod (¢°Z) may 


-eunso,T {7m “ IM} = MA OS “7732 mod g='m 


Ooav “Uj Op 7 OWN] op UOHeUIISa.p splod 9] so ‘Mm NO 
I=! 

(Gre eK eal 
aN 


: QULIOJ &] Op INdyeUIMSd UN suOJesTTN 

snou ‘Bj90 Inog *,~ squiosus.| op Imsed e sogmsow 
'€ Op SIN[LA S| JOSI[N suO|NOA snou ‘, { Joss Mog 

‘8 > 9y1un onbeys mod suomsour a snou 39 

ml uonemdod ep op / oyun onbeys mod ‘4 walt ='z 

J|QeLIvA k] SUOSSTUTJap Snou “Z op oUST] onbeyo yuRIapIsuo. 
ug ,N ote op A” @='Z suUOjOS mayd9A 9g] TOS 


I=! =f 


Le Ke Ae 


qv9 aN yN 


(77) 
A‘I= A 
> 7 JeIMNSIY 


Z81 


: (2661) oI[IA0q Suep Issne sano] 
uo] onb Z 1eYNsOI 9] JUOUID}OOIIP suOUd}gO snou ‘| yeINSEI 
np JURE “sOSITELUIOU SUdTT op sOLYeUT oUN,p UOTTUTJOp 
RB] ap juoUIa}eNp sfnoosp | yeyNser np oAnoid vq 
(12) T=" @ 

IS JUDUTATNS 49 IS S9ST[eULIOU 
sud] op some oun yso @ sual] sp soLneUI eT 
: 1 eMNsNYy 


‘yuored UN SUTOUT Ne B dT] 3.99 Wop yURUS onbeys 
onb aifIusis vj90 ‘sjuRJUd sap 30 s}uored sop ojduwioxa | sueq 
DIN: 5 cue Les, PeITICEMOC Sil), << 9 Is yUoWIaNe 39 IS onb seo 
9] 389,u mnb 90 ‘aystxa | [(” @"P)8eIp] onb mney [I ‘oruyep 
uoaiq wos *@ someu ve] onb mod ‘onb suojoN ‘snare 
07 ajeuoseip R] Ins A (QUUOTOD m9}d0A Np NO) sUsT] 
INDIA NP SJUDWI9TO Soy JURSETd Ud oNUd}GO 99.Kd SOLU PI 
yso_(A)SeIp no ‘ [(” @" pseIp] @ = ne: ie ia 
SUAl] AP ADLAJOUL e| sJoye snossmmaSP shen ay Oe" pO} 
= @"]T suoae snon ee Oye we anb 49 Ge 
= 9 onb suosod ueusjurepy “(*., op noy ne “{ 
uONe}OU e suOSTIN snou “JalI[durts mod ‘anb suoyou) , N 
Q][IB} 9p | 9p sUUDOJOO IM9399A 9] SO “T NO ‘A“T= ,A slg 
Issne suoAnod sno, “4 INS = g& 00 ‘9 219 uorepndod 
BL op A [2I0} 9] Jowysd suornoa snou onb suosoddng 

"gO 21 no “7"@ ap 
1 SOUUOJOD Sd] tied onb isure “,s 5 no “"@ op / sousty 
soa] Inod aonb ee /@ OP smMoj[ea 59] ‘uonbgsuos Jed ‘ja) sudt] 
Sd] 9.J[LUUOD SUOASP OU snoU ‘WeFU_ °, 7 1 ,/7 Sajg[duos 
suonefndod say oud sudI] Sop siMoyeA soy aQIeUUOD op 
omessaoou sed jsoU [I Guanbgsuos Jeg ‘(a[qvasI[s9OUu jso sUdT] 
op UOnROyHUApI.p sua[qo1d op osues 90 onb suojasoddns 
snou ‘UOISsnosIp v] JOYI[AWIs op UY ‘S90JOATp yUOS syuored 
So] IS ‘oJod UOSs JOUUONUSUT op ‘oIOW eS op osmtuaQUO | Jed 
guUOT}DITES URyUS sUNS! say UN Inod oflOyZIp ong wWeunod 
[I ‘syuvyus sap jo syuored sop ojduioxd.| @ SUOUSADI snNoU IS 
‘onbyeid Ud sIeJsHes & O[IOIFIP 3SO SJUTLIUOD IOTUIOP 93300 
NO S¥d SOP d}STXd [I “(ZOOT) S9][VAVT SUUONUSUT B | SUITUIOD) 
yN “" [=f mod sual say muajqo.p sjqissod ysa_ inb 
suosoddns snou ‘, ap eeynuepr 7 9yrun oyno} sod ‘o.yno 
uq ‘oouuo]]WUeYyoS / 9X1UN 93n0} Inod sayeNsTUTUUpe d0.N0sS 
oun & d0RIs NO d}OOTIP MatAJOjUT Jed suoneindod xnap soy 
OUD SUdT] Sd] SNO} JoyHUEpT suoAnod snou yp JusANY 
‘'gN “" ‘[=1 mod ssouepuodsaiios sa] Iua}qo.p ayqissod 
jso I ‘8 op f 9ytun 93no} nod onb suosoddns snoy 
‘SagINSOUU JUOas ‘asAyeuR oIeTUJop Ua ‘INb ,/Q ap ! 
SOUUN Pp sIQUIOU Np UOTVeUTULIAJSp ev] oyTIORT INnb 90 “(syueyUS 
€ NO Z ‘[ Je1ouds ud ev yuored Un ‘aydurexo sed) s]qIstAgid 
sutou no snjd yso_ ,s op / s9guuOp 9ylun oUN dUISTIO 
mod yuo mb sual op saiquiou 9] “(auUOTJUOUUSNS syURyUO 
-sjuored seo oy ‘ajduioxa sed) suoneorydde sop yednyjd ey] 
suep Yuowdsnomoepy “A JOIDUI.p s]qQeLIeA e] Jomsoul mod 


900Z eiquisc~ap ‘ajenbuae,p senbiuyoe | 


yospng UN I]qQe}d,P [eIDUdS Ud d|IOYJIP d19Av;S [I “Juonbgsuos 
rq “'@ suo] op soLeU ek] op jo ,8 gQuUONOEIIS 
uo]]HueYyDS,| op puedap [I Jed “IayOHUOD ke d{IDIIp jso 
4 Spun .p dIqUIOU 9] ‘SOURAL Pp S9UTLLIO}9p JUSUOTTONIIQeYy 
WOs ,uU uoT[HULYSE.pP oT[Ie} eT onb uatq ‘onb souUOHUSU 
op juryodum yso [I ‘onbyeid ona op jutod un.q y19}UT,p 
J[QeLIvA 9399 Op DUUOTOD Md}D0A J Ld Sided Gee 
WOS *, 2 a1Q!9 uonEndod vy op med e ‘A yQIQIUL,p o[qulteA 
oun suOIMSat snou *,7j s[quiesua,| ap 7 gytuN onbeyo Mog 
0< J0 » ,S>fEl,0>28 =U oMp-pjs89 ‘sa 
soyrun soy Jed gDCR! 7 Pp spun ,u sop s[quiosud,| 
gO WHOS 0< 4,6 sofjenbso] mod omp-e-jsa,9 ‘ayjnu sed 
}so U souRpUOodsalIod ve] sayjanbsaj nod , ap J soyuN soy 
SuOTJUAp! snou *,s suep sguUOoe[9s / gyrun onbeyo Mog 
22 yno, mod 9 </¥ onb suosoddns snoy f oyun] 
ap uonsegs ap guIqeqoid ey /% jog ‘eseuuoTHUeYD9.p 
ued urey00 un UOpes , /) op Med B sg ,u op ,s OTH 
-uvYydd |. SUOUUODETIS snou 4doTIPUI asepuoS og] SURG 
‘QP | Sp 9 UOIDOS BP] B SUILUXO 4So UONKSIUUdO .p sq 
-O1d 99 ‘SUONPUIT]SS sap soURIIeA Be] JUOJOSTUUTUTUN Inb ap 
OP SINITBA SI] JOYIOYIOA op JoINyeU 4so [I ‘sUOTeUISa sop 
uoIsIOgld vy Jaousnur ynod 7 30 / saat] soqytuN xnop soy mod 
0< 40 ap xIoyo 9] onbsing ‘sag uatos , 73130 ,N>f 
soytun xnop onb sy1]Iqeqoid ey e sjauuonodo.d yuos asejdnoo 
ap spiod say ° Le sJUDUIN[S XNB SINITeA sop Jonge mod 
gQ ® ,Q eu SJUOWdSIsaIUS .p osevjdnod sp snssad0id 
un.p ised e snuajgo asejdnoo op spiod sap uonesityn,] op 
JUIINISIP (TOOT) UOIWD 30 SOTTBAC'T “| SP SoJWdIOPIp sorstoyo 
a9 JUoIeLMOd solo uoUMOTPOIMeN *[ B SodXT JUOUSTdUITIS 
JUOS SodT] soyTUN say] nod hay ap smoea soy ‘suoneordde 
smoisnid sued ‘JOoJIPUI 9sepPUOS Np JURULLUID SUOTRUISO Sop 
UOISIOOId B] INS ONJUI [I ‘SUOLIOA OT SNOU SUTUOD “jURYOdUIT 
iso 0 < ZO Sp INo[eA vl op xlOuo a] 7 Jo. -/ “sorun 
xNop d.QUd UdT] UN 9}STx9 [I.Nbs1oT “~ = ae onb yuowlodunts 
suoxy snou ‘sag sed yuos ou, 31 ~ ,Q>/ soyun 
xnap No seo og] sued ‘ayeIonso UoNsonb oun 4so [ “0 =F @ 
sual] AP AILAJDUL eT Sp WONUI}QO | ‘orpUl ssepuos uq 


5 


On oP Ute des Om OT nu™ 40 
Gar 0M Or 0 Orme 0. 0 
OxnOzou Com, FOE bO mE yO 0%. 0 Onaluer es 
Oe Oe 0 Oe. OL tl is 
0 xe er Deir Oho OrmeOnr OnE LO 
0 0 OO Ot 
Jed s9uuop 


ySo SUT] Op sole ev] ‘pUUOMUOUISNs o]duUIeXxd,| op seo 
3] sueq ‘soytuN xnop soy aud UdT] UNONe 9}STxXO,U [I ‘UOUIS 
a < 6 onb uonIpuos & , ap / SUN] & O9IJO1 489, 
op / gun] 4p juowanny “0 < ae yso Juaug[9 onbeyo 
no ‘NX ,N oe op [,.e]="@ suey ap ao1qou oun 
Jed oguasaidei ano ynod Pa) suoneindod xnop soy 


ansojeyeo ne GqX-100-ZI .N ‘epeueg onbysyeisg 


oMUS soURpUOdsaIOD BT “7 99}0U }sd 9}1UN OnNbeYd no ‘sayTuN 
gN 9P eIqio uoremndod ey] gf Hos ‘outgui oq * f agqou 3s 
gytun onbeyo no ‘sgytun , AV op uoneindod oun , 9 0S 


"XNOP SI] IUD SUdT] S93] OAR SyURJUD ,p 
gQ uonemndod jo sjuored op , uonefndog ‘{ aansiy 


"| omsy ey B opysny]I 
4SO UONNIIS 99d) ‘SJURJUD Sd] JOMOITAIOUT NOANOd op juRAR 
sjuored op uoT]WURYDS UN IJOUUONDE[9S SUOADP snouU sTeU 
‘syuRfua sop o]]20 sd, 9919 uoKendod ey ‘syuored soy 
Iod onb asepuos ap aseq oun .p suorsodsip ou snou onb steur 
‘(a}09]]09 op soytun) sjueyus,p UoVendod oun mod suoneu 
-1Sd sop oimpoid suornoa snou aonb suosoddns ‘ajduioxa 
Jeg ‘suonejndod xnap soy aqua aystxo Inb souepuodsao0o Pe] 
ins ejao Inod yueXndde,s us *, 9 aqlo uonejndod oun mod 
uoneUss sun orINpoid sp uye ,/7 voHendod oun suep 
8 UOT[HULYOS UN JOUUONOI9S & d}SISUOD JOOIIPUT ddepUOS 
3] ‘UOHONpoHUT,| SUeP SUUONUSU sUOAR,] SNOU sUIOD 


VIIIPUI BsepUNS °7 


449 ul Pp 
J[QeLIvA ve] op sjuepusdeput 3a WoO} suas uN suep xnewNdo 
qustuayeso yUos spiod sao sayjanbsay snos suonIpuod soy 
onb isure “(jQ19}UT.p s[qeueA kv] Op sosor~noned smoyea sop 
Inod) ayqrey suas un suep xneumjdo spiod sap suospusrjqo 
SnON ‘oyyeunjdo, op swefgoid so] suoJoUTWexo snou 
uUyUuq ‘ddOW e] Jed sonuajgo suoneumsa sop uorsiogid 
yEms ~7 % ,Q euUs UOSIeT] ve] JURSST[QeId SUT] op 
SOOLICUI SOSIOAIP Op JO}JO,] SUOJOIPN|S snou “noT] swWaLNenb 


Uq (TOOZ) Woe 32 d9TTeAeT] onb sure (ZQOZ) s9TTPACT 
(S661) S9TTPART sup aLIOgP 919 B INb 9T]90 Jo aTJoLONneU 


spiod sap eBeyed np seasijei9ue6 apoujew e] ap S}JUsWAPUOJ S97] : JOSUIPUI BHEpuOs : aajjeAe7 39 AIIIAOG 981 


‘vo UbdIEISMoo] [PAL] oad : JaLUNOD "VWQVNVO ‘9.LO VIM ‘(ome1uC) emejngo ‘epeueD onbysneis ‘soT]eary] ool Sy Iesuo@)a][IAop 
: JOLUNOD “"FONVWUA ‘ZN OLISE ‘Teosed osteyg ons ‘uueyT Joy op sndured ‘(LSAuyO/TVSNA) Henbug.p onbysneig ap otoje10ge’T ‘ay[tAoq opneyj-ueer “| 


UONLINUIOT eT oud soURpUOdsaIOD ke] SUOJANUOUT snou 
Nal] ouIgIsIoN ug °,/ uonefndod oun.p omempgunioUut | 
sed 5) 91q10 uoneindod oun e , uonendod e] op Jossed 
B OJSISUOD dIOIUIOP 9WAD ‘SAISUL PI 10 STRIQ Op 9dUASQR | 
Op ‘qdOW PL] & seatoosse soyeiouas sajyotidoid souteyoo 
Ja0u0Ud Pp ONA Ud oNbIO9Y} oped 99 SUOJOST[N snou ‘sing 
(8661) a[Aoq sed JusWaMoarLIgue squasoid 99 & GqDIW 
PR] Inod UONRIOU 93399 Op UOeSITN TJ ‘do [SIOLNeUL UOTLIOU PI 
B QuourEj}oOU ‘Jodde vay Ib onbiio9y) osped un suep GOW 
Re] onb Isule ‘joIIpPUI asepuUOS 9] OILOSp Jed sUOIODUDUTUUOD 
SNON ‘O[PUITUTUT 1Sd SOULLIVA PR] JOP sieiq sues suOT}eUITSO 
sop juesinpoid xneurndo sptod sap “qqOW PB] Jed “11u9}Q0 .p 
10 “ddOWIW PI Op syuswapuocy soy dJIp-e-}s9,9 “OoIIpUT 
asepuos sg] sIONp op jso opoNe yuasoid np ynq I] 
‘soseusul sop soidne soyeu 
-Ipnyisuo] sajgnbus sop o}xayU0S 9] SUP (686) SUI sed 
ayLI09p splod sop aseyed op spoyjoU BI Op UOTSUd}xO OUN 4sS9 
ddOW XT 8 uoTHUeYog | op soytun sep osepuos ap sprod 
sop seigpuod suusAowl oun ev puodsa0s uoneUIyss.p spiod 
90 ‘UsoTeJUSUUpUoT *, 9IqQIO UoHe[Ndod x] op sgipmys 
oyun onbeys nod uonewnss.p spiod un ywumMoy JGOW PT 
UONLUINSS .p oua[God ap oJUNS 99 oIPNOsal op UTR “(1 00Z) 
uoIeDd 39 dgT[eART SUep ogjUasoId yUOWATeS9 39 “(Z7Q0Z) 
ag|[PAPT 19 (S661) O9TTeAPT Jed Jurod ne ost M9 & (qdDW) 


“xnewido spiod ‘steiq ap souasqe ‘spiod sop a3eyed np sgsi[e1gues apoujeUl {yoNpul osepuos 


sptod sap oseyied np sasi[e1ouas spoyjoul ey] ‘asepuos 9g] Jed 
SO9SIA d]qQIO UOyRINdod ey op soytuN xne ‘UOneUSd,p sprod 
uN NO UWONdITIs op sy]IGeqoid oun Ja1D0sse B D[NOYJIp el op 
yNOLINS JUSIA suUa[qQoid a] “synoafiq sed yuos ou suoryendod 
xnop sop soyun soy anud sual] soy Is JolMonred us 
‘ay[te1 op Yop un Jasod ynod yoomput asepuos Jed agipmy9 , 
g[qid uoNendod oun .p sonbysig}ov1ed sap UOneUINSd TJ 
‘JIAAIPUL ASDPUOS dp SIOTe oped 
uQ ‘suonendod xnap say] aqua a\stxo mnb sourpuodsa.05 
ey Ins yueAndde,s ua , 7 Imod uoyeumyss oun osmpold op 
uye ,/) suep ,§ UOT[HULYSS UN JOUUONIEI9S op JosesIAUS 
sioje jnod UG +, INod onb asepuos op oseq ouN.p 
asodsip ou UO ‘JUatIasnemMoyeY °,/] Inod uoyeuNse oun 
omnposd oyreynos uo J No ‘ayne] e oun] Seo] 6 P 
suoryendod xnap ap Joyred yuonbasuoo sed ynad ug *a4daT]09 
Op SoyUN sap a]][99 B UOSe] OUTL}IDO SUN ,P ddT[OI SOYTUN ,p 94ST] 
oun,p ssodsip uo ‘sagzreyNos 9499][09 op soyTUN sa] JURUDIUOS 
94ST] oun Jopgssod ap nor] ne nb sate [I Guowasnamoyyey| 
‘sogqieynos satqid suoyeindod say ospuroye.p usAow un 
JULHO ‘SOUN P SYST] OP dIIP-k-]S9 0 ‘asepuOS ap saseq op 
Jasodsip op apn 4so [I ‘sonbruou0s9 no sayeis0s saygnbus soy 
Nod soMesssd9U SUOTTHURYOS Soy JOUUOTDITIS Op ona U_ 


uononpo.nuy °° 


: S9JO SJO/! 


‘JQIDIUI.P d[QeLIeA e] Op syuepuodgpul jo 


LO} suas nev xnewjdo jusua[V39 JUOS splod sao satjonbsoy suep sUOTIPUOD soy onb IsuTe “(J919}UI,P BTQeUeA eI Op soJolpNoHIed 
smoyeA sop Inod) s[qrey suas un suep xnewmdo sptod sap suousjyqo snon ‘syyeurdo | ap owetgoid a] suoutuexa snou 
‘uyUq ‘qddOW BI Ms JoIJo No] Jonyeag .p uye xneieds sonbidAy sual] surez99 suoTpNyd snou ‘nal] swWgInbuld UY “SsoLeoIpUl 
so[qelea sop Jed sowdxe juos suoneindod xnap say] a1jUd SUdT] So] NO JoT~NoIIed sed a] SUOIOPISUOD snoU ‘naT] swWELyeNnb uq 
“SMANISULI} LT 39 STRIG Op ddUASQR | SUILUOS “GqOJ &] Op soaldosd soureyied suowuasaid snou “nary SwWsISION U_ ‘a][OIOLyeU 
uoNejOU eI JUeSI[QN Us onbJO9Y} oped UN sUBp SUO[NULIOJ ev] snou jonbsy suep gqOW | Op ndsode un suouuop snou 
nol] oWeTxnop UY “ddOW P| op JUouapuoy a] 9NAsUOD INnb YoompuT osepuos np UONdLOsap oun Jed ayngep spore yuosoid aT 


"a[qIO uoNe[ndod ev] ap sd3onbus gy1un onbeyo mod uoyewmnse ,p sprod un pumMoy GOW PT UoHeumsa p owiatqoid op ores 
99 SIPNOSE Op Ue (ZYOZ) S9TTBAPT 19 (S66) S9TTeART Jed juIod ne ost 939 B (qdqOW) splod sop oseyed np sgstpespugs 
spoyjoW VT ‘s[qQIOD UONe[ndod x] ap sogipme soy xne ‘UoNeUIsa,p splod un no ‘UOTDaI9s ap syI[Iqeqoid uN JoIOOSse 
B ONOYJIP V] Ip ynoyns yUIIA swa[qoid aT ‘s}ydefiq sed yuos ou suoyendod xnap sap saztuN say aU SUA] Se] IS JorNonsed 
ud ‘oT[Ie} 9p Yop un Josod ynod yoompur asepuos sed agipnje s]qio uoyendod ev] op sonbystisjoeieo sop uoeUITsd J 


‘JOAAIPUI ASDPUOS ap wou 9] syooidde 


3199 B SUUOp UO “xnop soy oUd yUQ}STXO IND sud] soy Ms yueAndde,s ua agyeYyNos s]qIo uOyendod ey mod uoneumnse 
oun osmpoid op ue o[qruodsip o8epuos op oseq ek] SURP UOTTHUYDE UN JoUUOTOETES Op JOSeSIAUS sJOTe ynod UG *d}09]]09 
OP SPUN Pp ISI] VP] V UOSR] OUTeLIOD OUNpP SadT] SoUTUN Sop JURUDJUOD dsepUOS op aseq oUN kB SgddB }Ie UO ‘sagzIeYNOS 9309]]09 
OP S9}UN so] JULUDJUOD OSepUOS op aseq ouN.p JasodsIp op no] nenb sawue [I ‘UOT[WURYDS UN JoUUONOeT9S 3NdA UO NbsIOT 


puINsyy 


_ S9TVAR’T A.L1a1g 30 a][fAoq opne[y-uvor 


spiod sap osvjz1ed np 
I9ST[VIQUIS IPOYJIUI VI OP SJUIWIIPUO] SoT : JDOAIPU BSEpUOS 


S8L 


anbojeyeo ne GdX-1L00-ZL .N ‘epeued anbyjsije}s 
961-S8L “dd ‘Z .N ‘ZE ‘1OA 
900Z eiqwaesep ‘ajanbus.p sanbiuyoe | 


et 4 


wn c 
= yon “thie 


“s Pare 6G 
a) tt Ve.) ae % } 


falgl~ bth, - iit t ete 
eh : : 4 Came Wane 5 4 rape 
ia) te. 

b 6 bs r = vi. ine Le ae 
eats ea naar | 
tay a Donat Abert a ea 

| dete ee 7 perlde Rafe Ee 

66 HT, hs we wh 

mye je jouer FL ba 

ast 


 bobitenen: er kes papiineyenuett y qoMry 
ic AU sll Schr adine alin casgeioaail 
en vee sla Fa cage ee ere 
ee Lecrig. tl! ota ee 
Peal Wie Hennes’ 


yr AS 


a : 7 

| aaa x merey" teat, he? eS Se | 
: eee as i a ; 

eae ry ‘bee saad inc lt i pps anes 

vay Fa . “Ter soe phot Pree sas a oad mee 

ORE EY | he ‘Syed Neil Oe, ite ‘qomunda 629 492 A wir rine: hem) 


si 14h ag se SPAY RUE uM KO. tty AR 
gs incest reg RHO AUEG MAIN) erie ie 
SU RONTOR: A aC: unt Champa 
ih i ENS. qpyendncgpal eerie 
me UO) coRRRIQN ge! comes ay 
Toe shies TDD Aaa es 
rite ware ‘beecny! yore 
0 haraatt geeingayane sre ve 
eames SADA NOR WAR AS 
aS RHO I A, MARR ORSON 

) omy hi sania apt cio gente 


1 non ‘ ‘ 


gat ecliptic ae 


+ Pl avery 8 
ies latin Shlhy: Mbnanali omen eeampaiee. ° 
oe io “a a 7 Me 1 ’) 
7 } P - oy to i 


Fone Muah aie 


ef Sraqenine set 
: <acronym 


no ; 7 
- oF itis 


oy si ie a Wc m 
ee WL 5. el mips ? 
nb eae HSI WORK SEE ap HrrEIeT pe) 
RIE: So emtae [SUD Nnebaa ti pephne 
eayeeegsy yp ang a mp sO ETRE, 5 re art: 
“Ee i RD 4 i sein (heagy) be’ 
aig aa ‘ope cia rR Nae. ora.) 
“iene: et mene! janie mis G & aetpalds 
pat mall manage A ERE ea Vie Tu etahs mi. 
Wd ronan ae ca! x yains rates 
wi, WAR ANG, G Ree AP 


ay ae ray gla NERO: 
= b eh ye Aw pte . ae % 


“yer 1 in aN 


ay! i sb hy, pane es “h\ 4 eras i Weare, 
we Ny ah thie ms Sine dpi Agee ae ry - Hetihice abe 
PARR ch REL RE MeN gE 1 pe EO 
ee ee DOG OR PAE FS PRR, 


we MUBINEY] carat gt # ae tag im ab (renivchl y 

KENPO RRNA Wii I 

ad abhi SND Se TAU VOn Rens! moe mbes 404 

Di tis ah’ Ss, : ball, ft? noF Mast “Hy ite eo We ats 
* $ : a) ; 

= ) wie Het gene a wp eet : r u diy wy nt Shea oh ts “4 | 

re Daya pe at ¥ ¢h th! im nae Aaies “eit 


tS v ae ry és whe kes ony) etiey te Ah 


a a | 105, ' 
Cabra a Heh EL NI ie y a a i ne iy’ 22-42" 
Pea? ¢ ont v7 ini peut qs Salk a digapm ne Ad 
i aes — r, vel sce Ana Ning Vout - ¢ ww ‘i a Y 
gt RRR va Pp edn nA MLR 8s IY 
" ae a astKbis serve Cae a ae 2 OO 
i OTT SIRES SAM cy apse t: io teyigene “pyeuni- 
De ae ae ion 5 AT A eke 
Aah negtnns og rt si eae re tater ‘ESRD 
PR iis: "bw ‘ate, b The PTY mg , ie 


icaw 
hi bph\ 


yan wien 
va ve x4 be An 


* sf: 


oe Hae 
Ls ' 


hy a 


iy oh A gc monroe TY bata sy) ig ® 
merce ob ay Oh in ec Be | AS tg ie CHM BNE yt 
HLM rho poeta a ai Leys a best eh ark os 
or 2 | 
my tl Bite. ‘wat vivtey Et wat bette hh ie PG el a t 
we ie Asie a ae a 
sae ee Me) eRe ame 
Jo he Rael ee: pan a: “Spee oat ya ice ot mae ) 


enn ine wnrTA Yip eapree hapaO aealo: TALLY 
ee, : hes ip ©) i ed GS. a (Oils ap PD. or 

Commeenganiesk SE aes oy ey a: Jen ab rgoeyaneny * 
PEIN MOE pe a Se a a aR WS MS 
JRO SEPARATE. GL gO RITTER onemenkey se yey LA 
Rg Ri ApeRats. afte: Re iti: RS 
scone, SAS SREP TRAN RS EN ot afta) ent! 
ms i Ba ae ES MARY 3119) OIE, 
Pe ih a te a la AMES WAN val 

RBS 8 Ane a par: eer i 
he on ee Weaw 4 gays 4 SAA 
Seg aT Hondas ap «the al oie tau ay CRO unl 
pare lai Hhlied snitacia a 2 my Syqeyh, ef Ares ahayyerersd 
2 RRR OTE IRIN A OH RAKIM Migyardpr ‘sp 


Mair 


meno + Hv, PERL) 1 MARLEE PSUS 
A) pepe, 


peice tinea SNR BB 
| | RARE is 


angoyejeo ne GqX-[00-Z1 oN ‘epeueo onbnsnes 


‘$L-S$9 ‘TZ ‘ajanbua p sanbiuyra I. ‘snsuad 94} Jo neoing 
np yeydes ua sasuedsp soy ins oyjonuue ajonbue., op suy xne 
UONVOYNVS OP SOU] sap Noyes oJ Inod nojsomprp 30 d9T[eAeT 
op spoyssur ek] op uoHRsIIN] (9661) “L “YZUerY 19 “Lf “eURIS 
‘(adj /sodedyeo Tearyn 
‘yeur MMM //:dYY) pIZ-LOT ‘87 ‘ajenbua p sanbiuysay ‘sosudanus 
sop soidne sajgnbua soy suep uoneoynens ey Inod nojsompry 39 
agT[eAvy] op ouUyILOS]e.| op uoHestTespugs ou) “(ZOOT) “d-"T “ISOATY 
‘S10 poloid-yypy Mam//:dyy Ty ‘eusny “euusr,, 
Suyndwuoy jeoysyejs Jo} uonepunoy y ‘Suynduros yeoysyeys Joy 
qUOWUOTIAUS pue asensur] VW 2y (SOOT) WRAL dog JUowdojaa9q Y 
"EL E-80€ *L “pouanor sajndwoy “uoryeztuuruT 
uorouny Joy poyjout xo[duuis W (S961) “A “Pee 3° “VL “OPION 
‘Q0E-L8TZ “9 “UONISUDAT 
U1 SOIjSIDIS “eyes pue suoyeindodans usemjoq uoNRoo]ye odures 
pue uoneoynens peundo (€00Z) “YU FISMOMOZIIIM 10 “g “PPTUpeT 
“St-S€ “pI ‘ajanbua p sanhiuysay ‘sonbunguiAse suonendod 
ep vonvoynens eB] Ing (Sg61) WW “Nopsonpiy 39 “d “opTeAry 
908-L6L “(59 “UouIsUDAT UI SONSHDIG ‘SKoAINS [eINQTNOLIBe UI 
poujJoul yoseds Wopuel SuIsn uoTROyHeNs yeundy (pO0Z) ‘WW YeZzoyy 
9L-L9 (Dp ‘anbysuypig ap ajouoyousaquy anaay 
“MOIADI YW :suoyepndod pamays Jo uoneoynens (9007) Wf ‘Ues10H 
TELS OV. 
‘UDIDISYDIS UDILIOUP AY], “USISop ASAINS UT s}TUN dBIR] JO uUNZeS 
Suuasoidos-jjas B@ JO UuoTONNsUOD sYL (9861) WW ‘nojsompry 
‘aIquistorp-siquiandas ‘pz ‘uoypysiulMUpp 
4 plnppojuoy ap f ‘eyep sununosse jo uoneoynens 
omewoay “(PO07Z) ‘MM ‘Aoouez 39 We ‘UesIoH “g “SuTuUND 
“S8I-LLI ‘0¢ ‘azanbua p sanbiuysay, ‘sonbiuyguisse 
suoyefndod soy suep uonjeoyneys ap sowiog op uoTjonysu0o 
RB] Imod swyWOsTe JaAnou uA (PO0T) Wf ‘UessoH 10 “g “SuTuUNDH 
‘TE-8T OE 
‘QINJYSUT [DOYSIDIG JouoIbUAaJUT ay) JO malaay “‘Aprys [eonstye}s 
@ UL S}IUN ddIR] JO ddvIOAOD aja]dWIOD ay) UO (7961) ‘['H “Tasse[H 
“6TT-6IT ‘OE ‘SOUSIIDIS jooYDWaYyDY fo sjouup “Uoneoy Hes 
qeuearun ul ynjosn uoneunrxoidde uy (6661) ‘ ‘Uewyg 
“TOI-88 “pS ‘vouplo0ssp JDIYSYDIS UbILaUP ayy fo pouanor 
UOHVOT eS oURLIeA WINUUTUIP] “(6S61) “Tf ‘SespoH 39 “YL ‘sntuayeq 
‘LLI-PLI ‘Tp SUPIOUSYDIG UDILIAUP ay, “Seare TeuOTeUQNS JOy 
SOZIS o[duwes SUTUTULID}O :sUOTIOOTTe JOMOg (8861) CW “Terueg 


ary deason qi 
"B NDNA NP SMI]VA Sap UOTIUOF Ud (SoTeUTy 
WLS IP SOU] OP Md9j09A 9) Y MOA 9] JOTNoTwo 


‘uljuq “Olea sed vu UOnesIUNdo .p UONOUO} v] ap MayeA 
RP] ‘sode}9 sarotutop (Q¢ ‘ayduioxe sed) w sap sioy ‘anb no 


to 


sodvjo .p SUP SIQUIOU 2] 1Sd YNO ‘Y= IS dIIP-e-]S9,9 

‘oqreysyes jso joe p sai eI Is oMMLOS|e| MUL “p 
‘e = "we olp-e-389,9 “Ma}D0A 

a] Joydoo0e sed ou ‘UOUTS ‘(OJUBAINS UOT}eIO}I 

oUN SUeP d}V.IIS Op SHUT] Op m9}09A a] sd '“e NO) 

e= '“e olp-e-qso,0 “Majd0A NedAnoU oJ J0}da008 

*e INd}JO9A a] SNOs onua}qgo a]J90 anb aed snyd 

SO |B INO}OOA OJ SNOs UOnesUNdO,p UONOUO] YI 

ap IMaTea v] onb 4o soylefstes JOS SoyUTeUOD Sd] IS 9 


‘UOHRSIUNdO .p UOTJOUOJ eR] Op M9[eA BI JOTNITeD q 


"¢ 38 € OU SLIdWOD OnE 
yelaop d ‘uowaryjenjiqey ‘(apuess jso uoNendod 
eR] onb ooaaja snjd jueyne.p yso d op moyea 
RI) uonendod op are, ev] soide.p istoyds guuop 
ronuea esquou un yuejg d ‘(d‘{)({-‘d-)3f 
‘osmoyegye § jonua siquou ag jyso f no 


Gi) tye t= ys0,” = 2 
‘f+'o=('p 


}INS [I SUILOD JURTFIPOUT vy] Ud sind 
'D dyes Op oT] ouN yURIN UD |B yUIOd 9] JoIDUaH e 


POwAINS sdujs!| Isjodar yy" “=a INod -¢ 


“SOIPIPOW O.}9 JUDATOP xNeIUT sjuIod say ‘sayrteysHes 
sed JUOS OU SaTJd IS ‘soyUIeQUOD So] IOLI9A “UONes 
-1WU}do Pp UOTOUOJ PL] OP IMITeA ey JoNITeD ‘oatyeurrxosd 
-de uoljeoyneys op spoyjou oun sed soagurUiojop 
SOANLUUTXOIdde JV.NS Op SOIT] Soy JURSTTHN US snud}goO 
a9 yUoANAd s}eI[NsOI sma]Iou op onb s9a9I onbyesd 
R] SIeur ‘sosipHN a9 yUOANed sozUTeQUOS so] JWOFsHes mb 
SOMOJVI[L SIOUS SOIQUIOU SOC] ‘SOTCITUI 9e.S op SOP] 

Op IM9}99A J] OIIP-k-}S9,9 “BW [eM MoJo9A uN MsIoyD “7 


UOTROYYES op 
J[QeLIvA VY] Op SINITBA Sop UOTOUOJ Ud UOnLINdod ze] JOU, “| 


‘JULAINS 9] 3SO OUTIL 
“OST ON = 70 (= 90 TS eae Be Fe ort 
(2919 Uone{Ndod xe] suep yuoUI[9 UN Pp oIp1O., sUUOp Inb) 7 
DOIPUI ,P SJUSWIZTS So] SUUdIAUUOD ayes 93399 nb UOSR] d]9} 
op Y a]eNs ek] JUOSsTUTJop B Nd}00A Np “pv yo | “4D syudUIgTE 
xnop ‘y UOnROYHeIS op d[qGeLIvA 9UN.pP SIMo][RA Sop UOTOUOJ 
ud 3919 os uoneindod oun.nb uoyipuocs Y ‘uorefndod 
op oye, ey ques AN “CN ‘T) ayfeArojur | suep Sao [ES 
sop puoid y] ‘yins [I ow0d moajd0A UN suUOssIUTEd 


900Z aiquiecep ‘ajenbuae.p senbiuyoe | 


"UONeIOpIsSUuODd 
ud sastid 3.99 o]nNop UNone sus JUdANd SoyJUTe.QUOD Sas dp 39 
uonesitundo p UONoUO} e] OP SOULIOJ sanne .p {(UONRUIT}SO | 
ap uoIsiooid op neoATU oJ INS auTeNUOD eI B SoddUTqUIOD 
(¢) soyurequods sa] no “(9) 18 (¢) SayUTe.QUOD sa] a9 yUdANOd 
‘uonesiundo p uoyouoy ke] uopes ‘tnb) « sayuTequod » 
xne jo (uonendod oun .p yueusAoid UOT HULYSE UNp oIIIe} P| 
NO sIpPNyd MoyeUIsd UN Pp SoURLIVA v] OQ nod Inb) « UONeS 
-wdo p uoNdUoJ» ev] B DOUdIZJOI SUOSTe} SnoU “UIOSAq 
ny ‘uUoKeoyneys op souraqoid sayne.p mod onb sure 
‘gone | Suep soyuasoid sowlatqoid xnop so] nod suuonouoy 
[inbsmnd ‘(soyurenuod sos jo uonestUNdo.p uUonoUoy 
e] sed suosstuysp ou snou 4Ip juatoNNe) UOnPOTHes 
PB] op Jornonsed ourayqoid ne souas9yo1 sed suosiey ou snou 
‘OUIYIOS]e | SURG UOHPoIHesS vl op [eouss ouaqold ne 
S[Ivjap Sods op suTe}IN0 Jo\depe e& SOUIOG SOUIUOS snou snou 
2 (POOTZ) yezoy Jed osodoid 99 ev Ns INnb oWIYWOSTe J 


oxouuy 


‘g[oIe JUdsoid Np UOISIOA oI9TUOId 
RB] Jorolpoule p stuused yuo may mb ‘xnaroaid soseyuoWU0S 
smay op ajanbua p sanbuysaz, sop yuiolpe moaoevpol 
J] 19 SINDJCUILULXS Sd] JUSWIOAIA JUDIOIOWIOI sone sa] 


SJUIUWIIIAIWIIY 


‘uoneolneys op soysoidde sanne .p suep xneyrur 
sonourered SWIUUOS sofyN ong yUdANOd yMpod s]]Jo nb uones 
-nHeys op syutod say onb steur ‘oyeudo sed 4so,u onbiysw 
-098 uonKoy yes ev] onb JoAnold op ye} Jediourid Jnoolgo 
OHON ‘somojesye uou syeynso1 sop onb isure ‘(o,qeuea 
eR] op ommowdse,| no uonendod ey ap aie} ey ousa0u09 
mb 99 ua ayduraxa Jed) uoryenzIs ev] WoOs onb ayjonb xnewndo 
syeynsol sop juesinpoid uoneoynens op swyjwose 
un dIMYSUOD B SION 9801 [I ‘UoNbgsuOd Ieg ‘SOpoyVoW 
S90 op ounone mod ssanoid 939 BU xneUIdo UOnROTHeNS 
op sjurod ap uoUI}qQO | Tey Ud 49 (POOT YeZOM) Spuvss JUOS 
uoneindod vy] op ai]Ie} e] 39 SayeS Op SIQUIOU 9] IS DdKOITJOUT 
ang ined (S961) PRO 1° OPEN ep spoyygut eT “(POOT 
YeZOY) SoMojeg[e syej[Nso1 sop WUIMOJ oMOJegTe YdIOYIOI 
op spoyjsur ek] onb sipue} “(Q66] SYZUery yo BULTS) HT 
SMUYIIOS]e | Op UOTesTIN | Op SIO] AUdAIs JUoAnod sonbiy 
-UINU sayTNOYJIp sap ‘ayduroxo Jeg “SJUSTUAUODUT sUTeLIDN 
ayuasoid sopoyjoul soo op ounoeyy ‘omoyegTe syosyooI 
op 39 HT Sowm{LIOsye soy Jed syinpoid xna0 vB sayquiquias LO} 
JUSTO SpOYJOUT 97399 Jed snud}goO syeqNsaI Soy ‘(IOI soyUasoud 
uou sjeynsor1) suoneindod say Joyneys mod (S961) pee 
}2 JOPJON op oxaydurs np spoyjour ey onbijdde suoAe snou 
4yso snjd mg ‘onbiyswoss uonroyneys ey onb saovoyyo 
snyd juos sjt.nb juRUOUT Ud sOUTYIIOS[e xnop sd op ayNe | 
no un] MoAnouroid ap ‘stozoyno} ‘sed y1e}9,U Ing ION 


ondojejeo ne Gq@X-[00-ZI oN ‘epeurg onbysyeis 


‘sorloyegye s}eynsol sop ‘oyeqoys uoyestundo .p 
OPOYJOW OWUIWUOS 4MUINOJ STOJVITe SYDIOYIOI op SUIYILIOS]e. | 
onb JOUSsT[NOS sp yUSTAUOD |] ‘sUUOP UOISIO9Id op neoATU 
un Inod uo][HULYOS .p o]]1e} VP] op UOHestuuTUTU eT e.Nb ajqeo 
-[dde sou mnb ‘YT oWYILOs]e | eB JUSWIAMeQUOD ‘(soyUTe 
-U0d sos jo UONesIUNdO.p UOTOUOJ 93N0} kB dIIP-e-3S9,9) 
uoneoyneys op oulajgoid jonb aysodui.u e onbiydde 
oe nod sMoyege oyoIOYOOI op WYILWOS]e | ‘sulowUeaN 
‘opm ONOU SP SIO] SLd II HO & PI9O SUIWOD ‘so[qe|quies 
syey[NSoI Sop yuostnpoid soyooidde xnap say anb ayqeqo.d jso 
[I UWorsIooid op oyeYyNoOs NedAIU UN I1Ud}G0 mod asinbe. uo] 
-UeY9d ,P IIe} VI JOSIUUTUTUN op jsd UONVO HENS P| op yng 9] 
puend ‘uonestundo sed saysoidde sap yueyuesoidel un your 
-9]839 189 (SRT) NO[SoMprH 39 SgT[eavyT] op suyyLIOS]e | “IO 
‘uonesmundo red uoneoynens op syooidde | suep omojesye 
SYyoIoydo1 op swyyose., anbiydde snou onb suojon 
OIL IP 
sjinb afqeqoid jso [I ef Ud ‘soUQU soy JOUOITeSsa9U 
sed yuos ou (uonestundo sed yo onbinsui0ss soysoidde so] 
Jed stuIMoy XNdd SIIP-R-3S9 9) DVS Op SOU] op soyquresua 
xnop soT ‘sojens soy suep suwojyTun jos oyenbue.p/uoyn 
-eoyeNs op s[qeuea ve] op UONNasIp ey ‘oyeumdo uoy 
-eoyens ey snos ‘aonb uteyiso sed js9,u [I yso snqd ind ‘uoTTH 
-UeY99 ,P III} VI JOSTUUTUTU B NO UOTRUISA | Op a19KOT]JO | 
Jostundo e jURISISUDD UONKOHeS ek] Op Myo op dsJOqJIpP 
[I Juonbgsuos seg ‘soyeys soy suRp UOTILOTIFHe.NS op o[qeLea 
RB] Op UONLUA SP SJUDIOLJJI09 Soy JasI[esa.p jso onbiyowi0es 
uOnLOyHeNS eT op yng aq ‘aydumts yso uOTRoI]dxa | ‘slofoyno |, 
‘oyuoUsNe soyens op aiquiou a onbsio] yworoe,s onbu 
-joul0gs uoTeoyyHeNs ey e JUOWOANeIedWOS UONesIUTdo 
Jed 39 YT soysoidde say yuenbijdde us osiyeor ay1ovoyjo.p 
ules 9] onb yey Np JOU} Ss WeLMOd Uo ‘ona oIoTUOId YW 
‘onbiysu0es UOnKO es vy] onb saovolyyo 
snjd yuos uorjyestujdo sed oysoidde J 19 YY oWIYWWOSTR | 
onb onboamnbs sues juonbiput sayeroynie suonepndod 
sop Ins yuRLIOd saydINYOoI Sa] ‘sayjoor sonbryowAse suoyey] 
-ndod sap ms osAmsinod as plop swaqoid 90 op opn9,T 
‘(900Z) UeSIOH Jed 39 (pOOT) UeBIOY 30 SuruUNy sed nusgo 
mnjeo e gsoddo yeynsg1 “(gg61) Nojsompry 10 sgy[eAry 
Jed oagquesoid ayjao onb sovoryga sulow jsa onbiyjowo0ss 
uoyeoyneys ey onb oyuenjouO0d UOSey op JUONUOUT syeyNSOT 
sou YlOIOINS oq] ‘sooRdTJJa NO soyeuNdo ayeNs op soy] 
Sop SUNOS sospiesor ano sed yuoIeIADp dU sala ‘oUOD 
zed ‘uonestundo sed oyooidde , mod xneniur sonouresed 
suog op dUIUIOD sadiapisuod ana judAned onbiygUI0ES 
uoTBoyHeNsS ey Jed soguUOp 9}e.NS op SOUT] Soy ‘SUTOLTURON 
"SoJINSUOS soyeQs op siquiou snbeyd 39 sorIpnjo UONeindod 
onbeyo nod onbinsuioes uoneoyneys vj onb sovoyyo snid 
IDIOAB 4S9,S (OMOJVITe SYdIOYIOI 9p 19 HT SOUIYILIOS[e sop 
uoAour ne) uonestundo sed oysoidde | ‘opm9 ooUu sued 
‘ae. P| op UoneINdod ap ay]Ie} e] Be oMoLIOdNs no xnop ke 
DIMILIDJUI JOS SVS SOUTLLIIO Op JURUDAOId SUOT[URYDE Sop 


sOCINE.p UOSIeJEdWOD BU : UOHeSILUIdO Jed Ja sNbujaWOEH UOHedIJ}eIS Bp Byooiddy : EWUa/ Je YeZOY ZBL 


andojeyeo ne GqX-[00-Z1 .N ‘epeuRD snbysneisg 


aqyre} ey onb (49) no (uoneindod ap 9y1un suNone JUOIpUSTUOS 
ou salja.nb oy0s ap) SapIA jWUOdIOS soyeNs soUureyoo 
onb ynod as ]I yp JUoUTONNe {(¢) sayUTe.QUOD xne sayno} sed 
JUOIOFSHLS SU SdjIN.ASUOD sayeys soy onb sqeqoid js [I ‘oN 
uq ‘(uotstogid op sinbos neaatu 9] IU9}qQo mod o{[Ie} spuess 
ap uUoTTHURYOS UN.p UOHesITHN,]| JoWssooguU NO) dIDOIPSW 
UOIsSIOSId ap SUOTILLUTSO Sap B JOUDUT yUdANAd yMpoid s]][9 nb 
eS op sayy soy onb usiq Is ‘oaneurxoidde spoyjou 
oun, p yse.s I ‘slojanoy,, ‘Uoryeoyneys op sopoyjoul 
somne.p & 19 (6S6]) SespoH 30 sntugeq op soouonboy 
SOP SdLIVO SUIORI BI OP SANLTNUINS UOTJOUOJ LT Ip spoyioU 
eR] & yUoWOAeIedu0S Jonbydde ve sydumts san yso ou OSS 
uos ‘Juowgsiooid snd ‘yyeoyrusis osejyueAe uN apossod 
(pOOZ) UesIOH 30 SUTUUNDH sed ogsodoid onbinou09s 
UOISSoIsOId dUN INS s9pUOF UOTLOYHeS op spoyjou eT 


UOISnJIUOD °sS 


‘onbinewio0es uoneoynens ey onb saovoyyo 
snjd yuos uonesmunjdo sed syooidde | 39 YY vuoneoyNnens 
RB] ‘[e1oues us nb suonjouod snou ‘s}ej~Nse1 sou soide .p usu 
-dAdLIg ‘JHIA[GO 99 sIpUIOYe INod 9sT[YN WUIY}WOS]e | 9UIIO 
-uoo nb 99 ud yUoWTduNIs yUOIOIpP yo (JONONIed uONRO 
-YVeNs op swug{qoid 30 suep) Joofgo ourour sy] xNOp sayno} 
yuo Soyo ‘yey U_ ‘onNe,| onb sovoyJo snyd ysa soyooidde 
xnop soso op oun. orb Jorejoap op sed juayoulod snou 
dU SOOUdIDTFIP soo ‘suloumuKaN ‘UoHestudo sed oyooudde | 
onb ‘ouuog surow nod un ‘sone .p sup jo omoaypow nod un 
ySo HT UOnKoyeNs ey ‘seo suTeyINN sue “soTqe[ques UOT 
-ueYyd9.,.p SaT[ie} sop yuostnpoid nb uonRoyHeys op syutod 
Sop JUOUUOp sapoy}sul xnop so] onb aynosgp II UoryestuuT}do 
Jed oyooidde | & HY] OWIyIWOS|e | op uosteredui0s ey] 9q 

‘SopNyd SINI] Op SOT 
QAIOSGO JUO | (900Z) UPSIOY 19 (POOT) UeSIOY 30 SuTUUNH 
SUIWUOD ‘s}ey[NSOI sIMd|[IOW op sUUOpP dIOTUJEp 9399 onb 
JOALUe ynod [fT ‘onbinswioes uoneoyneys ey onb sovoryyo snd 
yuowionbyeurgysds jso WT owWYWWOSTe | onb sed suowayye uu 
snou ‘SUuIOWTUvONY “(101 sajuasoid sed yuos ou sjeyNSoI 
Soq) sagigues suoAe snou onb saqualayip oLnowAse p 
}0 O]][Ie} op suoneindod soyne.p mod opey yuouoTes9 suoAe 
snou onb uonjrjejsuos ‘onbiyswioss uorjeoynens ey onb 
sovdlJo snjd juowonbyeurgysds j1e}9 HT oWIYWOS]e | ‘opm 
oNOU sup ‘anUOd Jeg “HT swYWOSTe | onb sovoyyjo snjd 
reo onbiyow0ss UoHRoyHeNs vy onb gye}su0d UO (900Z) 
uesioHZ] onb Isure “(poQz) URSIOH 30 SuruUNyH ‘suuOnUSUI 
velop suoAe] snou sWwWwOD “YT 30 onbrm9swoes suon 
-CONLS Sop MOVOyJo,] op UOstesedwio0s x] ap asedop as 
QULSSOIQUT UOISN[OUOS oun ‘dno UW “9‘T & OIMOLIOdNs JUST 
-nbyeulgsks j1R}9 SANLIOI QOvOIYO, J ‘soyens op siquiou 
onbeys jo uonejndod onbeyo inod oyey 939 & UOTRAIESgO 
o900 ‘onbiyswioss uoneoynens ey] onb sovoryo snyjd so 
uonestundo sed oysoidde | aonb s}eJnsoi sap synosep I] 


L8b 


*(sayeQs soo 
Op soyie} xne sainotiodns justej9 soye.ys soureyiso op yueusAold uoT]HURYDE ,_p 
So]]Ie} Say) sonbrzauunu sowe{qoid sap gsod v oJe.1]s op SoTL] Sap UOTUA}GO , J 


00'T ANG, Cine SSE SSE 8SL fe 

00°T LOT LOT 6S7 6S7 66 9 

00°T €0°7 €0°% $Z9 (1 1879 vL7I S 

00°T 861 861 68 68 89L I 4 
g uoneindog 

00°T = = 007 007 = iL 

10'T 877 OE 7 CHT Ove CSS 9 

00°T Cie S1Z% 10€ 1O€ 0S9 iS 

00°T S07 S07 607 607 6£8 v 
p uoneindog 

00°T 917 eG S6l S6l CCV fs 

00'T SOT b0°7 Ivé CHT S6v 9 

001 861 861 pOe £0€ 109 ¢ 

00'T 061 161 Ilr Olr 78L v 
€ uoneindog 

00°T (TE NEG €8 €8 O81 E 

€0'T 761 861 SNE! ell VCC 9 

90°T TOT vit €9l vst 6CE ¢ 

70'T 98°T v6 1 6ST SVC £87 v 
Z uonemdog 

00°T 98°T 98'I Z6L! 861 LSE L 

00°T €8'T Sah Ce CSE 09r 9 

00'T Sia Sal vee ve £19 S 

00°T €9'T €9'T 967 967 S08 v 
[ uoneindog 

umdo HY HI CUT) undo ote) HIy unjdoy, W0I374 T 

$3}¥.S op 
d1QUION, 


(4 HTy79) uonesreundo sed oysoidde J e yuoWAANeIOI HT 
OUIYIIOS]e | op 19 (HT F719) pT oupoSye, | B JWOUIOANEIAI 
anbinawi0es uoneoynens ey ap “(24° F375) uonesrumndo sed 
ayooidde | & JUSWIOAN IOI oNbISUIONS UONROTF HENS ve] op oyOVdTJO 
10 (Tu) YT oumt08ye J 10 (Pw) uoNestundo sed oyposdde | 
«(%°81,) onbinewi0e3 uoNRolNeNs ey snos ‘uone|ndod op suuexour 
B] Op IMSJLUINSO,| SP UONLIICA 9p JUdTOYJI09 9] nod [9‘0 ve a[ese 
IMgyeA ouN I1u9}q0 Inod sasinbar soyewturuT UOT[HUeYOS ,p SoT]TeL 


€ nvolqe 


"€ NvgTQe} Ne S9QUUOP JOS (()[) SOATLIOI SOILOBSTIFO SOT 

30 UoIsIOgid op nedAtU 990 nod sasinbal uOTTHURYDE.p soTeU 

-TUTU saq[ie} soy ‘sed onbeyo suep [QQ op 39 UOTSIOOId 

Op OXI] NKdATU JI ‘sayeNs / ‘*** “p= 7 Ud UONLndod onbeys 
ayneys suoae snou ‘sayooidde sioy soo jueAms uq 

‘yUOUOATOOdSaI 

‘soyooidde .f 30 ,2 So] snos (Ad) uorsI99id op gyreynos 

neoalu un Iuajgo mod sasinboi soyeurun uoTHUeYDe .p 

soy]rey soy quos (A9)‘u 30 (Ad)'u yo “(YT ‘umdo ‘woes = / 

1) uoNROHeS op saysoidde sap saoiput soy yuos / 49 7 NO 


(ao)'u 
(01) (asym 
O[NUIOJ VT Op UdAOU Ne sdonyeAd 
919 JUO sagredut0d saysoidde sap soanryal soyoRoyye sa] 
‘(] omnsyy Jo | Nes]qQR} 110A) 
quspsooid uses ve] & nb suoneindod sourgur burs say apna 
guasoid vy od gsI]yn suOAe SNON ‘oTOJeITe DYOIOYIOI op 
Spoyjou eT UOTOs UONesTUMNdO Jed oyooldde | 19 WT ou} 
09] | ‘onbinswioss UonROyHeNS ek] NoOAes ev ‘UOKnROeNS 
ap soyooidde sto. soy suoreduios snou ‘uoyses ayussoid ey] 


900Z aiqwas—ap ‘ajenbue,p senbiuyoe | 


ansdoyeyeo nev GqX-100-ZI .N ‘epeueg onbnsneis 


V ‘aovolgo snyd yuouayergues 31e}9 o1OTUUIOId vy aonb 93e}su0D 
19 (SE61 No[sonpIY 39 s9T[eAv]) NopBompr 19 ogTeAeT 


op owmjwose.| e onbiyowioss uoneroynens ei oreduio0o ‘puvIS }Sd SdJIN-QSUOD saye.ys 
yUO (9Q0Z) UesIOH onb sure “(pQ0Z) UeSIOY Jo SuTuUNH op siquiou af onb yueyoduut snjd yuenep yso dy1ORKOTIJO.p 
ules og] ‘e1ouss Uy ‘7 30 C‘] aNUD jeLIRA aTJO ‘sone 
UOHVUISI, | 9p 9XIf UOISINg1d op so] Inod ‘suosreurquios xnop mod onb ¢‘] e omoloyul 
NVIAIU SNOS UOHVIYHV.YS 9p saqdo1dde 71219 .U dlOvdT]Ja JT ‘onbinswi0es uoTwoyHeNs vj onb sovoyyjo 

sop 9y19¥vgJ9 | 9p onbrigumnu uostereduioy = “p snjd 939 & uoNestuMdo sed oydoidde | ‘seo onbeyo sueq 


“sagIplys soyjoloynse suoyetndod say suep uoNKoyNENs op o[qeieA ev] op souMUeIZO\STY “[ 2aMS1y 


¢ uonerndog 


000 0ST 000 001 000 0S 0 
es iy 1 


souonbe1y 


sIvl 


p uoneindog ¢ uonendog 
000 09 000 OF 00s z 000 Z 00s I 000 1 00s 0 
L ae —_ ed =e! 


souonbe1y 
aouanbely 


eo 
Se 
6£6 L s 


Z uonrndog ] uonepndog 


000 0€ 000 Sz 000 0@ 000 ST 000 OL 000 $ 0 
I 1 1 1 1 1 | 


souonbealj 
souonbely 


000 T 


00s I 
007 I 


00+ I 


€tL I 806 I 


g}OCDINS p UOSsIeJedWOd BUN : UOHesiWI}do Jed ja SnbisjaWOSH UOHedII}e4jS Op Bydoiddy : EULIa/ }e YeZOY OSL 


ansojeqeo nv Gq@X-[00-TI oN ‘epeurg onbrsnejsg 


73" 7L00°0 veloo ik 
00°C 0800°0 19100 9 
98°T 0010'0 $8100 ¢ 
9L‘T ve100 S€70°0 14 
s uoneindog 
00°7 Z£00°0 7900°0 L 
€6'1 8¢€00°0 €L00 0 9 
eI Lv00°0 6800°0 ¢ 
p9'T €900°0 v010'0 v 
p uoneindog 
161 L900°0 67100 Li 
08'T 1800°0 9r10°0 9 
pL'l 0010°0 vL100 ¢ 
9L'I €€10°0 S€70'0 14 
¢ uoneindog 
CLA 7r00°0 €L00°0 i 
99°T 1S00°0 $800°0 9 
Lvl $900°0 $600°0 ¢ 
Ler 7800°0 91100 14 
Z uoneindog 
Cla 6700°0 1S00°0 L 
99‘T 7£00°0 LS00°0 9 
99°| 7r00°0 0L00°0 ¢ 
EST 9S500°0 9800°0 14 
J uouneindog 
en demnat ya wiydo AD u10a3 Ne) T 


$9}¥.)S dp d1QUION 


(undo'uoesy75) yornestumdo red oyooidde | e 
yUSTDATJeIedUIOD onbINSUIONS UONROTFHeyS 
B] ap ayrowoyyze yo “(™"“°AD) uonestundo sed yo ("* AD) 
onbijow09s UoHROT Heys op soysoidde say snos uonefndod 
Op SUUDdAOUL B] OP INdJVUIT}SO,| OP UOTJLLIVA ap SJUDIOYJI0q 
¢ hes[qeL 


‘(sojeQs op siquiou x UONRindod) sarpnje uosTeu 
-Iquios onbeyo nod (6) VOHRA ap S}UdIDIJO09 sap 3 (g) 
SOATILJOI SOTOVIYFO Sop SINICA Sd] JUSTJUOS 7 NevoI[qQe} IT 


( ) 5 “x ie undo 45 ¢ "x a' woes 5 
6 3s undo oe ; 1s woes = 
Cy" A): (ye 
: sopooidde 


xnop say snos uoyeindod op suuadoul ev] op moyvuINysa,] 
OP UOYLLICA IP SJUSTOYJOOS soy g[Noyed sUOAR snou ‘ano Uq 
‘yUOWOANOOdsal ‘uonestuUNdo red 39 onbinsuI0Es soyooidde 


woos 


So] Snos ([) sooueLeA say qos (*x)™"°4 19 (%x)™84 no 
( "x) et undo ‘wio09: 
(g) ¢ ™, = nd "9 


: QPNULIOF vy yUeNbrjdde us sayeyos oy10K9 
-IJJ9,] Q[noyeo suoAe snou ‘sayooidde xnop sap o}1OedTJO,| 
Joreduios nod “(pogz) UesIox 39 BSuTUUNH osWUIOD 


gOI x TT 9€S9T6 ZS  S8998I-6S7Z 0007 g 
OIxT% IP9I9E OCP 86£ L—-c9 000 OT v 
,Ol x09 TI v7 Sore Col C9 O00 7c e 
I x8r S6ETRZ 99°7 8LS 8c-Eve  O000P v6 
8S IT‘91 Or'l cL-€ 0007 I 


sourneA suUdkopy oLowAsy — onpuayq ayiey uoneyndog 
SooIpnNyd soyfaroy ae suonendod soy tnod somewos sonbystye1S$ 
[ neoqe yl 


6L/L 


‘onbINSWIONS UONROYHeNS op spoyjow 
eB] Jed soouTUUojop 918.8 Op Soy] soy xNenIUT sonouesed 
SUIWOD +9ST{N SUOAR snouU ‘SIOTUJop oy00 suep ‘uOTIeS 
-rujdo sed aysoidde | anbiydde suoae snou ‘sing ‘sajeys / 
y0 9 ‘CS ‘p Ua onbiNOWIONS UOnROTHeNS op spoyjou vy sed 
uonendod anbeys s1jne.ys SUOAR SnoU “I9DUDWIUOD Od 

‘uonendod ,7 ej ap oyjiei ep so ‘AV 
30 onbynsyjodAy osevuuoyyueyos .p uoNoey oun 4so ¢{‘Q = f 
no ‘Nn f=‘u ye uonendod 2 eve mod ‘“’u ‘oly 
-ULY99,P d]][Ie} BT ‘SJOUS SdIQUIOU sop JUDIE} UOTROTNe.YS 
OP SI[QVLIVA Sap SIMITPA So] ‘SaT[9EI1 SuUONendod soy suep seo 
d] JUOWIATVIOUNS jSd LID SUUUOD “(owWIaINbuID ve] nod 7—‘¢ 
e uonefndod osomuoid ey mod Op‘, op weuea otoulAse p 
JUdIOYJOOS a1) onbrnswiAse yUOWOATISod j1e}9 UONKOTHeYS 
op sqeiiea ey ‘seo onbeyo sueq “] omsy el e souUOp 
yuos suonendod soj suep uonroynens op soyqeiiea sop 
SOUMLUBIBOJSIY Soy ‘] NeaTqe} ne sogyuasaid yuOs suoTye[ndod 
S90 op soleus sonbysye}s sa ‘(000 OL & 000 Z OP qweITe) 
SOJUDIDIFIP soyie} ap soyporoynse suonendod burs gsgugs 
SUOAR snou ‘UosTeIedwI0d Pv] JasI[eoI Mog ‘UOT[HURYD9.p 
OXY I1e} SUN JULYOS SIOPISUOD Md}LUIT}SO | SP SOULLIVA PI 
JUOSTUTUTUT INb aes dp SOIT] Sop dydIOYdoI op sua,qoid 
un e soonbydde ‘(umdo) uonesmujdo sed oyooidde | 
yo (Wo0d3) onbinsWIOss UOnROyHeNS el ‘UoNeoyNeNs op 
soyooidde xnop suoredwios snou “uonses ayuasaid ey VW 


oxlj UoTHuUeYyI9 Pp 
IIIv} SNOs UOHVITHe.Ys op saydoidde 


Sap 921¥dqJ9 | 9p onbuigumu uostviedui0y = *¢ 


‘opnyd oyuasoid vl ap snares 
Sd] Sno} JasTTeaI od (sQOT Wieay, s10D yuoWdojaaaq Y) 
Y WoOwWouuoMAus | 39 odsesuR] ] SI[WN sUOAe SNON 
"SOJVIYS SO] SITN.QSUOD 
Inod omoyegie syoIoyse1 op yo onbinoswioes uoneoynens 
op opoyjour ey onbydde suoae snou “YY woe | 
ONO (8861) NosoMpTH 39 s9][eavT] op sponse] JoyNsuos 
‘OUIYWWOSTe.| Ins suoisiogid sop mMog ‘yey snd gap 
-ISUOD INja0 oTduoxe Jed ‘souratqoid sonne.p e ajqeordde 
sed jso.U [I ‘oMuoo sed Suonvoyneys op stood owlazqoid 99 
OIPNOsal Op onA Ud dJoTNOHIed UoHestuMdo .p spoyjsu oun 
OUILUOD SIOpPIsUOD oO Jnod (QR NO|[SoMpIH 30 SdTTeAe’T) 
(HT) no[sompryH-sgyfeae] ep owjuosye,T “(uonejndod 
Op [e}10} Np no suUdAOUT ¥] Op M9yvUISd UN ,p doURLIeA PR] Jed 
s9uuop 3so Inb uorstoeid) UONeUIT}sSd | 9p NNOA uoOTsIO9Id op 
NvoAIU oJ JURYeS UONKINdod sun .p juURUdAOId UOT[WURYDE | 
op a]le} ev] yUosTUUTUTU INnb soyeNs op UOTJONSUOD PI 4Sd 
gjonie yuosoid 93] suep oUTWeXd oUIaTgoid oUWorxnep a] 
(P007) YeZoy sed gyqnd sponse | 
Ins gseq sWYWOS[e | [Iejep Ud yWOSp oxouUR,T “JOMWEp 
90 dovjdural [I ‘Juapsooid a] onb may]1ou 4sd 9}e.NS op SozUUT] 


900Z aiqwecegp ‘ajanbue,p senbiuyoe | 


Op I[QUIdSUS JOANOU d] IS ‘JUOWOMOJVITe SdTJIPOUT JO JSUT 
-OT1OJEITV IDUUONII9S Sd 9e.S op oUIUUI] oun ‘adey}o onbeyo 
B ‘oT CUIIs jSd SUUYILIOS]e 39d “UONVOYHeNS vy] 9p sway qold ne 
aidepe orojegye SYOIOYOOI Op SUI WOS]e UN Pp y1Se_,s |] “suo 
-ejndod smoisnjd Joynens mod (p90Z) yezoy Jed gsodoid 
su LIOS]e | onbydde suoae snou ‘apnys ajyuosoid ey sued 
‘oATeUTXOIdde UOTBOHeNS op spoyjou oun 
yso onbiysut09s uoNnvoy Heys ev] Juonbgsuoo seg ‘aylejsnes 
sed ylos ou (¢)saUIeNUOD sop oun, onb JoALUe nod 
TI ‘IO “(¢) sayurenUOS sep tu “(Z) UoTTHURYDE,| op UONNIedgI 
PR] op Tu ‘([) S0URLIRA B] Op INU] ev] op TU 9}duI09 yUNT) OU 
onbrjsuio0es UoNROy Hes vy aonb JoUST[NOS op JUSTAUOD TI 
‘(pOOT Aezoy ‘ojduroxe sed) soumyyosye .p uoneordde 
-oyne.| JWdANOS yUaIssooou Inb ‘saovoyyo snfd sapouysut 
sop Jonbijdde .p ajqissod yuauayeso 4s [I Juepuadas ‘(696 1) 
Peo 19 JOP[ON op oxo|duuis np spoypysu ke] est[yn wo (€00Z) 
TISMOYIOZOON A 39 TyUpsT ‘soyqruodsip uonesnmundo.p 
SOPOYJOU SASIOAIP Soy WuIed yey a9 Op x1oyd up ‘aydutIs 
snd jyuoWqeiopisuod sUyyoSsye un ylombor dJOTWIEp 
9300 onb sored onsed spuvis us ‘onbinsutoes sysoidde | onb 
Jonbrdde e aployjip snyd yso uonesmunydo sed aysoidde J 
hee Nestea K 
KE NCN=) ” 
(E007 FISMOYIOZOOI AA 19 FYTUPIT 
‘TOOT ISOATY [QR6] Jopyueg) (uoywoojjy samod ‘sreysue ud) 
« souRssInd saAe UOTIedsI» op spoyjou oun Jonbijdde .p 
Q]qissod jso jI ‘oyeys onbeyd suep owow os] suToW no 
snjd jos uorsidaid op neoatu aq onb yndA UO | IS ‘slojieg 


aul 


da te Le 411 0) 22 


(9) Ty -u= 


a 


alt 
re) 
(9) T-7°" T=y mod "ns “US 7197 < 'N 
SQJUTL.YUOD Sd] SNOS 
‘(Z) oyeumdo uornsedar ey snos (1) soueLea ej yso ("x) 4 no 


(r) (CO A= ODS 
JOsIuTUT : JUBAINS otUETQoId np onbi 
-sumnu uorjyestundo | op omdsut.s Joynonsed uoneoynens 
op owiayqoid 99 ev sonbijdde uonesujdo sed syooidde J 
‘ayes onbeyo suep suJojiun 10] 
oun jins Y ayjonbey uoyas asoujodAy,] ns asodar (¢) aynwUo} 
eT Cx) =4  Cy)xeu= 7y‘Cy)utm=0 no 
(¢) PEA seers 
(FOOT URBIOY Jo Suruuny) 
onbiystu0es uolsseisoid oun Ins daseq yins nb synuoOy 
ey Jonbydde ev yuowyduis aystsuoo al[q ‘saves 7 soy suep 
X Op UONLULA op JUDIOYJOOS np sAMgjeA say soyeso sipudr op 
Jyoaf{qo nod ev uonRoyHeys op onbinswoes sysoidde .J 


y IY 
SUN mee 


T ul 
N-4)= Uu 
yM ( 


Go aa 


ansojeyeo ne Gq@X-[00-ZI oN ‘epeueg onbysyeisg 


: (€OOT PISMOYIOZIOL A 
yo TyopeT) yodwos osem e aens soar osyodoidde 
oun e ogjdepe uewAdN op umundoy op osjnwuoj ey 
Jed aguuop jso “U UOT[HURYDE,p dI]Ie} BT JURYOeS (7) GOURLILA 
eR] op uonesmurunu sed ‘owafqoid anou op seo 9] suep 
‘quongo s nb ‘UoT[QURYDS, | op syeudo uoNIedsl eT 

“To T=y 3 aes -y eB] sp ssvuUOT[HULYdE .p 
gyun .y ve] mod y op mojea ey yso “x yo (7S) OstuUAI 
sues o][duIs oMoyeg[e SseUUOT[HULYDE snos s}e.S .Y ve] SULP 
X 9p uonejndod op suushowr ej op mayeunso,j iso “x “TOTS 
aseuuo][nueyss snos Y op uoyendod sp suusdour vy] op 
moyeurNsa | js “x ‘ayes ,y PI B QUIONSOI Y op uoNejndod 
op soueLeA ve yso Zg ‘oes .y Pop oyfie} ey ysa “Wy 
‘3B. Y B] op JuURUdAOId UOT[HULYDE | Op oT[Ie} e] Iso “uw nO 


1=Y Uy Ap See 
(iors SAG ical ERK Saat ae i Na Koes 
ty I N Gl 


qed 
oouuop yso “x op soueLieA eT (‘ajuepuodsari0s aygnbua.p 
J[qeliva v] v onbyUSpt JULIO SUTTON UONROT eS op s[qvLea 
R] suoey snou onb JousITNos ap judtAUOD ]]) ‘jo]duUI0d 
ose e aes ooae oyoolidde oun e 9uIqUIOD 39 (JS79) 
SdJV.YS Sd] SUBP ASTUNOI SUBS o][dUIIS aTIOJegTe osvUUOTTHULYOS 
dAB HVS aseuUOTTHUeYDD snos Y op uoNendod 
op suUdAOW BI OP Md}VUINSO UN,p sOURLIVA ve] SSTUUTUTU 
inb (y op oyeurxeul moyea ey 7y Jo oyeUTUTM ImoyeA 
BL yueg = “Ty >t > Ly > °y) He c+ 6Oy) = y oyeNs 
Op Soy] Op ([ +7) UOISUSWIP op IM9}90A UN SUOTYDIOYDOI 
snou aonb suosoddng ‘wu uoj[nueyos p oxy oyj[re} ey JUeYORS 
SoyeQs J oiInysuod & 9}SISUOD JoMWUOId J] ‘UOHROyNeNs op 
soula|qoid xnop suoJapIsuod snou ‘oporyIe yuasoid a] sueq 
‘Y UONROY eS op sqeuea oun .p 
SINITVA Sop (OpNd,] Ip NgSp 9] JURAR SIIP-v-}S9 9) edap 9] 
Sop NUUOD AV UOTSUSUTIp ap Abies Eta XonolooA ULL ANS 
yuepuoy snou ud ‘7 ‘soyUn Ay op onbrnowAse yuoWOAnISod 
uonendod oun Ja1yHe.ys suonteynos snou onb suosoddng 


sog1vdui0d UOnHvIyHLAYs op soysoiddy °7 


‘uonesiundo .p sonbriswmu sapoy}sul ap 
uOHESTTNN | INS SopPUuoy (FONT APZOY “€OOT PISMOAIOZIOL 
0 PPUpST “8g6l Nojsompry yo og[[eAey]) Uonestu 
-ydo red uoneoynens op soysoidde xnop ap aq[99 & (P00Z) 
uvsIOH 39 SutuUNy Jed sgsodoid ‘onbinswi0es uONRoT nes 
PR] Op sylovolya | Joredwu0d ap jso aponse yuosoid np yng aT 

‘(POT URSIOPY 30 SuTUUND) o7e])s O][9} 9UN Pp UOTVOIO 
ey sed puoiduioos ou onbiyswi0es uoTeoyneNs eT ‘yo[dwos 
ose e& ges ouN.p uoNONysUO x sed yuR}Jodui0d ou 
UOTVOyHe.YS op sapoyjour soy onb (onbryowiAse JUsWoAnISod 


SOCOIJJO,P UOSIeJeEdWOD BUN) : UOHesiWIdo Jed 39 eNnbujJeWOEb UONedIIeNIS ap Byoouddy : BUJa/\ 39 YeZOY Q/| 


‘Ul'09OOYRAM)6 [VULIOAIU : JOTILINOD “EO €6L Ulg ‘opuy ‘eAvjeysopy (tuedeieg) wrerury ‘proxy romp 
UoIsaYy “HAN Joy xofduiog yoivasay YVOI ‘Sousneig 2 sommouosg [eimj[NoLUsy JO UOISIAIC ‘eULIOA Wey poy] ‘[d'mem'MISs'eSOUIOM)yezoy UIOIeU 
:JaLUNoD ‘ousoJOg ‘dIAOSIeA 9//-Z0 ‘6S BPYSMOUASINOMON ‘STAOSIEA OP dfOOLISe S}ISIOATUE, “SINEWIOIQ 9p jwoWoyIedsp “yezoy UlOIeY, ‘| 


yso uoyeindod oun is juowonbrun ‘oureyioo uodsey op) 
soovolye snyjd yusulayjanjiqey jUOS sapoyoU sad ‘sonbiynout 
-Ase JUSUIDAISOd solqevueA soy Joyen op UshOW -moy]Iou 
Np 113e;s [I ‘ayes oseuUOTHULYDE | Ip 9}X9JUOD 9] suRC *[ 
B g[eso ayIqeqoid oun soAe UOT[HULYDE | SUBP SQUUOTDEI9S 
JUOS SJUDUIZTO Sd] SNO} JUOP (9R6] NOSOIPIH $796] JOSse[H 
‘gjduuoxa Jed) « yo[du09 sei &» JIP dJe.Js OUN SIINSUOD 
op jueyoued uoneoyneNs op sopoyjow sop 10919 op 
dXkesso JUO SINdYDIOYO op dIQUION ‘UoHRndod oun .p uoNeo 
-YJENS LP] op SIO] INQUye 399 op ajdu09 Iu9} op yuR}JOduIT 
}So [I Guesyoe seo oT ‘sonbiysuAse JUSWIDAISOd JQIOUT.P 
sgjqeueA sop jyuoyoduiod sajonbud sosnaiquiou oq 
(ZO0Z ISPATY) 
yeoo] winuuTuT un WUIMOFJ op onbsi uoNestuMdo | ‘uoUTS 
‘oyjenb ayney op oO JUSAIOP SoTeNIUI aes op SOU] soy 
‘UOWOTTOINVeN “xNenIUI syutod soo JoyosoyooI Inod saegsTn 
ang juoAned soaneurxoidde uoneoynens op sopoyjsu 
so] ‘Suonestumdo.p snssadoid of J90uR, mod soyenrut 
SOUT] Sop JUSUUTETTaNAIQeY JWoIeINbal o1Udd 99 ap SopoyJoU 
So] “SIOJOINOT, “(HOOT = APZOM *€OOT ~—PISMOMIOZOI A 
yo TOMUpST ‘{gg6] nojsompry 10 osgfeaeq] ‘ojdutoxs 
Jed) gens op sayy soy osmpoid mod uonesmunydo .p 
sonbuisumu sopoyjsw op no sonbrdde-ojne sowytiosye .p 
uOTeSITNN J] Ins sospuoy yUOS saysoidde sag ‘sayeurydo isenb 
suolyeoyneys sop yuostnposd mb ‘aguearun uoneoyneys 
R] od yuourosorpnonsed ‘sayooidde sap astxo [I ‘smoayre 
Jeg “xneumnjdo uoneoyneys op syutod sop yuowWaqerapIsuos 
Jouieo9g S yuoAnod yuIMoy a]ja,.nb uoneoyHens op syutod 


op owyosye ‘onbiounu uonestutydo 


‘onbuysul093 


so] onb uarq Is ‘sAneurxoidde uonroyyeys op onbruyse} oun 
yso onbinowioss ayooidde. | ‘saousnbay sop saued ules 
PB] Op SAQLINUINS UOTOUOJ LT SP IPOUJOU LI Op IeISUT.] V 
-soqqeiduoo 
suoyemndod sap soynens op ona ud dspoy}oU 3300 
onbydde yuo (p9Qz) AsoueA 30 UvSIOH “suTUUND ‘soored 
-W0d sopoyjoul soy Tuned sovoyyo snd ey yea onbiyow 
-0983 uoljvoyHeNs ve] onb anuowW ke opmd Uos ‘neoAnoU 
OP (8861) No[somprH 19 sgy[eAvy] op 30 “(6S6]) URULAY.p 
‘(6S61) SOspOH 3° sniusjeq op sopoujow xne onbiysui0ss 
uoneoynens ey sreduroo & (990Z) ULSIOH *(Q86] Noysonpry 
}9 O9[[PAPT) (HT) NopsomprH 39 sgT[eaey] op ouUOSye. | 
aonb 39 (6S6] SespoH 39 snIuTeq) soousnbey sap s91Ie9 
OUIDeI BI Op SANR[NUIND UOTDUOJ eI ap onbisse[d spoyjour 
RT onb sovoyyo snjd yo ronbydde e oylovy snjd yuouroyou 
so oW}LOSTe Imoy onb anuow yuo (POQZ) UesIOF{ 30 
SUTUUND ‘o}e.S onbeyo suep SUJOJTUN IO] OUN yINs s[qQeLIeA 
ey] onb osoyjodAy,] JURNOUID Ud ‘soje.YS SOSIOAIP Soy SUep 
UOneOYYeNS op sQelieA ouN,p UONLLILA ap yWdIOYJo09 np 
soyesa smoyea sop amnpo.d e asta onbrysuo0es UOnRoTHeNS 
ey] « onbijawio0es syooidde »» yuoura{dumts no « onbryswi0gs 
uoneoynens » “« uonRoneNs op onbiysuoes syooidde » 
onbruyos} 31300 suojayjadde snou ‘oyordwis op ronos 
Jeg ‘onbinowogs uorssoisoid oun Ins gseq uUOnRoTHeNS 
ap suyLIOS|e uN gsodoid yuo (POOZ) URSIOH 19 SuTUUNH 


uononpo.ynuy *T 


“NO|SOIPTH-99] [PACT 


uonroynens ‘ayeumjdo uoneoynensg : sajo sop 


‘uornesnundo red sysoidde | 


Inod yedap op syutod suog sp sUIWUOD sagJEpIsUOS aj9 JUdANEd onbinsUIONS UONKOyNeNs vy] Jed SOOUTLLIOJOp oye.I]S Op SoPTUUTT 
So] ‘SUIOWTURAN “OUUY}LIOS]e 390 onb sovoyJo Issne j1e}9 UOHestuNdo Jed syooidde J onb sipue} ‘YT ewYILIOs]e | onb aovoyyo 
suIOW 31e}9 UONLOyNeNs op onbryswui0ss spoyjou ey onb g[gagi e UOsIeIedWOd aad HT WYWOS]e.| e uoNestuUdo 
Jed yo onbrygwi0gs soysoidde say szeduiod suoae snou ‘anno uq ‘onbujaswi0ss uoyeoyNeNs ey onb sovoyso snjd y1e}9 
uonestundo sed syooidde | ‘stpm9 seo onbeyo suep ‘onb snbipur e sonbiyouiAse yuotsAnIsod soyjaroy tse suoyefndod buts 
Ins yueyod sAnereduios onbusumnu spny9 sup) “SoyUTeUOD sas ap jo UONRSTUNdO .p UONOUOJ k] Sp SWIOJ 93N0} UONRIOpIsuOS 
uo oipucid ynod uo ‘uonestumdo sed uoneoynens el op seo a] sueq ‘onbijawAse yuowdAnisod uoye;ndod oun aynens 
uO .| onbsio] aympoid yuowsTjonjIqey yso Inb 4Yayduos oseIM eB oJeNs oUN,p UONONsUOD ve] op a}dur0o sed judy OU |[I sIew 
‘soysoidde sone xnop sop xnoo e JUSdAeIedUIOD s]dUIIS soy Jsa onbDINSWIONS UONROyHeIs v] op suyJWOS]e "J ‘soyewmdo 
UONRIFHL.YS Ip SOpoyJOU Sap SUIWIOD sadgIapIsUOS ae JUdANed ‘sonbuisuINU sapoyjeur sep Ins JuoInddes nb ‘sayne xnop 
soy onb sipue} ‘uoneurxoidde oun jso uoNRoy yes op onbuysui0gs sysoidde J (HJ) nojsomprH jo a9TTeav] op opoyjour 
ey Jed jo uonestundo sed ‘anbiyswo9gs spoyjou oun sed uoyeoyHneNs ev] op soysoidde sap uostesedwioo oun suuop spore J 


suns y 


, BULA A WIRY PIA] 39 YVZ0Y UL.AvI| 


9}1BIJO,| op UOSTvAvdu0s ou : UONLSsIUndO 
Jed 33 anbryjour09s spoyjow oun avd uoneoyynens vl op sypsoiddy 


ZLI 


anBojeyeo ne Gd4X-L00-Z1 .N ‘epeued anbijsije}s 
E8L-LZL “dd ‘Z .N ‘ZE IO 
900Z euqwedep ‘ajeanbue,p sanbiuyoo | 


7“~.S e 
e +e - an 7 » 
ae 
a by F 
» @ @ +f 


; ar oo PRE DAN HMGEOAN, 
as Se rn oe Pa timing, ERAN, Apetp oe 
a i‘. ie M te await) Tews war? 
, * nN | 
| oe Fee ‘Few ee ae 
. were. fw) (a Bones tonal dei 
a . | sotqavetn.p | . 
ad, aed Te ts (oF) AM anid) (ociyaccaiaat ye P =2 9: 
ry) ee "oa =U iain |. Ley (aha Te) (ead 
» Fa u ; wy rho pb 


#is 7a a +. a + rl 6) eR PPG) Fae ey 
vo” “Wa Or) ° aa Ge Rady =rhab feghn' 


re hvtayr * ai. en Une -ee 


et ee), I oS La ~ te 
ewes Sor! 6h Re BY al: eee ee 
perc y ra pe eh eet mn Sm AE Te beam Dy ME , — ; 
7 Bre (sep Sree sp erat yal, A eaAPER ITSO OP | ody eo iis) DOr INE ot ¥ 
. ie ‘ to + snongn . ie : 


ee 


eh . mr 
il bie) Rep Ab i To Tes hue , a ie igen’ ig ‘ann 27 Fuk) SUS lo ‘ uy Sarin “al 
7g a 5 GRASCIAY cy ta BOG PL Te os, (9 Lb On 9S Sa 0d Ar Sp Gees, ps» OF YT TR 


ales Nanna casey os eed Gea oom Aer ee ao “edwin ‘geet ney | 
y eearuns a} eh TERR. | * Vea a Wied VED Se TA 8 RD TED > yi" AL am Ts 
ont *) eran) 4 Dee Wh ye MEARNS eae gan ay Weecameoe in . . 
- Le at? | it ae” > mm a0 ITF uy ats ri. 4 Pige iG 5 5 | ny Lal ar t ‘ ¥. 'buale ia 


eo aga >“ Rpm etgame woot; acta gtr pm angel on m7} | 
FG y|Osy prow MEST. yy Oe 4g, ay Seiad rh oe ; a Muyo 
ts sea mis. ara AeA a Ay 4k aye Egg cache sate A ead aad ~ Fe tg Kule 
e* ae yt ro Wei i, Tye MeyINS ANLAE Fe il mp 4 oft ean? an por’ ae Bs eupGlac) 
'd ouctamee year Cae ink GRETA he NAc: SRE ery he oe fio ear e rs 
PME. OMY. a6LircR LiAnGROE ze-Tyay’ jaMeMGue De oe MLN OE E008, EO 49, 
Sbrqeercc” ay iat EE cay Peetge Gone? pee eh HR giana: | —ponmes: 
. = iiantiz' pry grey Res pagans: See its cya ty a ie +4 nda ou “ ant 4 [ me ll een rr 
ar? J. 14 AOE. ed Ade My at : ls bs ¥ Lugs apy '\ ea fol AR, 
2 i SANE AB Get, Waban fi : ‘ she 
1) +" we uy 7 wilt pee. ' 
sat pes Wes ee nes ape Bar A a 3 ‘ Pen aaa J) “= ~ Re 
ie ae ir SRT rs 
aisiaianidedls nage Dae are es | 
et esnceha Sy ne Be we Bho i a \ P 


er ye “oe a A ob : pecan A ae ie ae ee 
re WrAL or. . ; 4 a 
aeoe * eee eosin Mais oye 


Fawr GEL 


eee 


PMs © fig ab SA ON te, eat 
Ma pie pean oir" ae? & hPt, a ah pt -. jax’ 
‘Oa OY 6 ry Sees OUT. Shans . 
cance be tes, ar yotnes Quetta thant, ye 
‘ Tw tyr a edias toe anid sian 
Dy aie, Deen Lr ee a 
v DOWER ON a8 Tit) xy, 2 <PNN 
Racer a ey ; / _ YROSER Ch Wp 
bce “efor 


feu. it Tee IZA 
Wan hs — 


trois ‘einG Eyes GAR 


' 
. 


‘ 
— 


ansojeyeo nev FqX-[00-ZI .N ‘epeueD onbysneisg 


"PSI-SEI “07 ‘soususiinig fo jpuAnor uD\poUuD) “yep 
AQAINS JOJ spoyjow deys}oog sey) Suuedwio0y (47661) WY “ovis 
“SOL-SSL ‘LQ “UOIDIDOSSP [DIYSYDIS UubILaUp ay) fo pouAnor “eyep 
Asamns xojdwios Joy smpaooid Surjdwesel VY (&7661) WY “Ions 
‘SeLIOA-Josuuds 
: WIOX MON ‘do.sjoog pup afiuyyove ayy, (S661) ‘Gd ‘NL 3° “ff “oeys 
‘88ZI-8LZI “16 “UoUDIo0ssp jDOUSYDIg UbI4aUp ay) fo joUANOr 
‘eyep AAINS poyndunt Joy densyjoog (9661) WU Aus 39 “¢ ‘oeys 
‘SeLIOA-JosuLds : YIOX MON “suljduws daaingy 
paisissy Jape “(Z661) “f “URUMOIM, 19 “{ “UOSUaME “q-'D ‘Tepes 
"817-607 ‘LZ ‘ajanbua p sanbiuysaJ, ‘saguuop op omoyegye 
uoyeindut.p sed ua sagjede1 sogiqyinbs sonbrjder yo syodor 
uoy[HURYoS-ruep B densjoog “(100Z) “WY “FHUIS 19 “f ‘oeYs “H ‘osteg 
‘pLE-99E “18 
‘UOYDIIOSSP JDIYSYSYDIG UvIAaUp ay) fo JOUANOL ‘asuOdseIUOU 
gjqeious! YM sojdwes wopuer osduis woy vuoneunyso 
[eAJoyUT Joy UOHEINdunt spdyNYy (9861) ‘N “JoyusyS 19 “E'd “UIqny 
‘O€E-V76 “OL “UONIDIIOSSP JDOUSYDIS UDILIAUp 
ay) fo pousnor ‘Apnys yeouidurs uy :JOyeuIsa UOISsoIsO1 IeOUT] 
uonejndod oyu oy (QT861) “‘D'M “PuepoquinD 39 “WY ‘TTeAoy 
‘LL-99 ‘QL “UOYDIIOSSP JDIYSIDIS UDILIAUP 
AY) fO JDUANOL *SURLILA SY JO SIOJEUUTSS pue JOJLUITSS ONeI 9} 
Jo Apnys yeourdue uy (&T861) “D'M ‘Puepoquing yo “WY ‘Tesoy 


GLI 


‘TpT-1 EZ “€8 “Uolplo0ssp 

JOONSYDIS ubddauUp ayy fo pousnor “eyep AdAIns xaydui0s 
YM soussayur Surjduesoy (8861) THO TM 1 “WN ‘Ory 

‘DOJO SUNULIG JUSWIUIDAOD “SQ 

> Od “UoysuTYseM “E9ET-S8 “UoHeoqng sdIAJog YIyeoH lqng 

“66 ‘ZT OLAS ‘sousDIg Yybaz] puv joj, ‘Sujdues uoye;ndod 
oyu pue densjoog oy] (S861) “A'D “Uspmous 0 “fd “Aye Do] 

‘St-STz Juauigtddng ‘g] ‘sousysioyy fo 

jeudnor upIppUud ‘sayeuutyss ADAINS Ul SIOLIO dINSBOU 0} Spoy}oUr 
Joyjo pue densjoog (8861) £A'O ‘TM 1 WNT ‘Ory “O'L ‘Teaoy 

‘P8I-[8I UoKRIDossy 

TeoysHeis UeoOUTY ‘spoyjapy Yyoswasay AaAANG UO UOIJIag ayy Jo 
ssulpaad0ig “SKOAINS {dures Ul UOTRUIT}SS URIPeP| “(O86T) *S ‘SSOID 

"6€-9E “UOHeINOssy 

Jeonsneg ueououry “UO1Iag SOISIIDIG JD120§ ay] fO SsUIPaaIOAg 

‘susisop Adams oidures xajdwoo ul sjuauodwios soueLeA 
Joy Supper (1L61) “A’A “Yeys 39 “TC ‘ssojkeg “qry “Wosjoy 

“687I-Z8ZI ‘68 

‘UOYDIIOSSP [DINSYOIS UubILJaUP ayy fo jouanor ‘suonetndod oyu 
Jo} spoyjow densjoog “(p661) ‘d ‘TRH 1 “MA “Ppng “O's ‘Woog 

‘C8V-0LV 

‘ZI ‘sousysypig fo spouup ayy ‘suydures poyneys ut dens}oog 
oy} pue Ayyeuuou onoyduiAsy “(p861) WC ‘Ueupssry 9 “fd ‘OI 


ay dvasolqrg 


900Z aiquwisasd~ap ‘a}enbuse,p senbiuyoe | 


onsoyejeo ne FqX-100-ZI oN ‘epeuey onbysyejs 


VIC/EETMN 17860d OUND 


“TWIOSE ‘Joqey] youyg (euleN) oloddesg, “sog] ‘pustg pjoH QeOSON, ‘UeYIYTYSOY, : sogytoeds sonbieyy 


(gb‘T) (LI‘L) (SZ‘€) (S¢‘0) (€0°7) 
6SLE S‘9OrE £667 7097 8‘8bZ 
(00‘0) (00‘0) (Z8‘0) (79‘0) (10°) 
v'6rS v'6rS S‘9E¢ 0‘00S €‘Lor 
(¢r‘T) (g9°Z) (00‘0) (0r‘0) (€T‘0) 
v16 £68 6S8 88 rIL 
(19‘0) (Z0‘0) (170) (€S‘0) (p70) 
OSTE 1667 C817 CSST v'6£7 
060 SL‘0 50 S70 Or‘o 


(ad4}-1na2) (suok QQ0 1) 
UoTmaey 2 .P 
aynuend pod 
(ad4j-ma.10) (suak QT) 
uoyTHueyp? .p 
ayyuend »(SoouUed $7) A191 
(odA}-mo.119) (uat) 
noyHUeyse Pp 
gjguend) —_,(uooeyy |) suejueysur ged 
(odA}-ma.2) (suak QT) 
uoy]HueYs9 .P 
ajnueng) (34S) ZA 
d yINpolg 


dNd.| Suep 93U9A op sjutod synod sa] snod syinpoid surezss9 op (sodAj-sinaia) UoT[MURYO?S .p seyHUeN? 
p nes[qeyL 


‘L661 9P dNd.] SP SepuuOp 
So] TUINOJ MOA’ p uoder np aLysnpuy,| op 39 sosOUUIOD np 
‘QMUOUONT | Op d19\sTUTUN a] onb Isure ‘suOT}ROTUNUATIODYII |, 
Sop Jo SaSOg Sop ‘somorgUT some sap ‘onbygnd uonsey 
eR] op asgystumu oy ‘onbysyes ey ap neomg 9d] yUoTOIOUIOI 
siInone sx] “epeueD Np studs Ud jo SaT[omMyeU saoUdTOS 
Ud SoYydIdYIeI op [I9suoD np ssmoq oun sed sgouvuy 99 
UO ININV sUIIISIO.N NP xndd ‘UOneIDOssy [eonsHRS ueder 
ey Jed sgouvuyy 939 JO INoyNe SWIATXNSp Np xneAey soy] 


SJUIWIDID.AIUIDY 


‘uoder ne 
L66| Ue douUoU xd say Ins seuoneU s}gnbuY,]| op soouUOp 
xne osoige gqqq.| onbydde suoae snou ‘uonensnit.p 
on V ‘osolge qq] onb somoyegye soiquiou ap suoyesoues 
op snyd oyIssooou I stew ‘7 = UoT]MUeYDE.pP soe} op 
UOSICUTQUIOD 93NO} Op JUOWO}Ie dT OJOULIOd op osRIUAR | 
B [e1oues qqq. 7 ‘de.ns}oog UuoT]HUeYSS UN oIIN.QsUOD op Ue 
‘QouTULIa}apoid ayIqegoid oun soAv o90RICtUIdI Jos ‘anuUd}oI 
ylOs }Sso gUUOp daIsOp UN ke dsevUUOT[HURYDE,p gTUN 9UN 
‘sopoyjou xnap soy sued ‘Jelouss qqq.| 19 9sq1qe qq. 
: SopuvIS JUOS ISEPUOS Op sUOT}OBy Sa_ NO soIsep smorsnyd 
B soyneNs YSSVq suvyd soy JUSUIOTIORF Joye. op yUoyouLIEd 
inb 1nousag odAq op deys}oog np sopoyjour xnop gsodo.d 
SuUOAR SNON ‘ojURYOdU 4so o[QUenb sed uONeUINsd,] 
onbsioy yuoWdIaNonIed ‘saxayduioa sajygnbua sap seo 
Q] SUBP SooURLIVA Soy JOUISS od ayHn 4s deNns}oog FT 


UOISn{IUOD °9 


‘O][NU a9 nod souse od Aj--mo19 J 19 JoNonIed 
xd UN MS dNUDOUOD 4Sd SUOTWAIOSGO .P 9AdTP aseJUDOINOd 
un ‘sed 00 suep ‘onbsind ‘oyozeur uoq soy yuos mb 
xnoo mod uou steur ‘syimpoid xnoiquiou ap mod siqeidacoe 
ong yelAsp uoneurxoidde ay00g ‘snunUOD jwdIR}9 SII,s 
oumu0d dens}ooq oa suonbydde snou 4uepuadas ‘sjarosip 
yUOS guUOp jINposd un,p xLid say onb suojON ‘p neayqe} ne 
sogquasaid JUOS 9yUDA op syutod synod say Jed snpusa sympoid 
suteyiod od sodAj-smeaiue smo 39 oyUeNb red suoneurnss 
SY] ‘Ssoyqiey Juos oisop Jomwoid op asepuos op suonoey 
SO] NO ‘SOSEIIIA Op JO SaTIIA saqnod ap sagsoduriod saws so] 
suep ([— “u) 4so sonbydes sop arte} e[ no (Lpz osed “c66] 
NI 30 OVYS) dsTWdI S0Av de.Qs}00q ds] SUOSTTHN snou ‘smare 
Ieq ‘Sol[IA sopueis op sagsoduios sayeys soy suep osoiqe 
qdqq.] suosojdurs snou ‘sayens sop uoneuuojol sudy 
‘O[QvdSI[SOU JSd Sd}V.S SOP UONLULIOJOI PT Op JOJJO,] onb 
suosoddns snon ‘soye.ys Q8Z ap snyd aysTxo [I ‘UotodnodaI 
sudy [][‘O] ofeasoqt., suep osuidwios jos ‘({°¢) Jed 
sauuop ‘“d onb ayJ0s ap sayusoelpe sayeys sop e sooIsoquI 
JUOS OIU9B 99 op SoIBS SI] ‘Soye.S souTeLIOO sup, “U> Op 
‘anno uq “qd nes oun.nb juouuaTyU0D ou sayeNs 
soureylad YSSV_.] Jed sutxoidde ong jnod onbryeurgysAs 
oseuuo][nueyos,| onb jyuesoddns ua ‘qNq.[ ep soouuop 
xne osoiqe qqq,| suonbrydde snou ‘uonses oyuosoid el WV 
‘QOURLIBA INI] SP UONRUITSS | OAV sorjqnd 
yuos sudAour xd say onb sipue} ‘qNaq.[ op Wodde. a] suep 
xtid ap sayguenb sap suoneuinss xnev d9100sse js ,U SOURLIVA 
eB] Op UONeUIMsS oUNONe ‘yey U_ “UOT[MWULYOS .p soyWUeNb soy 
Inod soueLea ev] ap oyodxe onbydyeue uorssoidxo ounone 


seibap sunaisnid e aiess eHheuuoy|UeYydS | NOd I\;NOUINg 9dA} ap dejjsjoog : eplo| ja JayIS ‘Obles ‘eyoeun4 Pll 


angoyejeo ne GqX-100-Z1 .N ‘epeuRD onbysneisg 


O}STXO U [I ‘aTfI]duuIs UOTJIPUOS 31199 SNos SUI. “YSSVA.I 
red guirxoidde ano ynod onbryeugsks oseuuo][nueysg | 
anb suosoddns snou ‘soueieA ey] Jounmsa mod 4uepusdad 
‘onbyeurgysXks oseuuoTTQUeYysa uN JWoYOdUIOD 10-So]I0 
onb sored ‘qNq.J op sesuuop soy mod opiyeA soueLeA 
op s[NuIIOJ ounone aystxou [I “Jojed yuowosdoid Vv 


SOBETIIA 


L81 T/T 9ES 7 000 OF > JO SOTTTA SOM 
soseyIA 

Vv S/T ce 000 0b < JO SOT]TA SOq}O 

08 e/T VCC 000 0s > SOTTTA 
6LI e/~ OCC 666 66 — 000 0S SOTA 
GE I/I eee 000 001 < SOTTTA 
uo]HULYDS,|  oB8epuos uonejndod uOIsal 
epeteL spsuonoel{ Adf).P agN RB] Op oye L op aL0s9ye- 


L661 2P dNd.| SUep disap JoTWaId ap asepuoOs op suOnoRIA 
€ neo[qey 


p66] Op SdJOUIUIOD Np JUSWASUD.OY Np SIO] s1eposp jonuue 
SOJUSA Op FIYS np 39 9JUDdA ap jyuIod ap odAy np uoNdUOy 
ud suUOpsJo onbyeugjshs oseuUO][QUeYyDa Jed sIsioyo 
yuos (G4) oUdA op syutod gp ‘aguUONSeTEas sjgnbua.p 
uoIsaI onbeyo sued ‘aisap aweisio4 ap aspuuojjyuvyrq 
‘01 39 [‘Q ogue sastdui09 

JUOS 9139p OLD XNSp Ne IsEpUOS op sUOTOKY sa] ‘ayonbusd.p 
SUOIS9I Sd] JOUUOT[HURYSS Inod 9siTYN 3s9 onbyeuUrg}sAs ose 
-UoT]WURYDS UF) ‘dJUdA ap sjutod YQ] UOMAUD.p saNjysUOD 
sunoeyo ‘“(qSQ) ajenbusa,p suoisar ud dsdgsIAIpqns 4s9 
souUOT[HURYSS oy]TedrorunuT oun ‘a.nUOd Jed ‘a}U9A op syuIod 
s}jod say Mog ‘qUdA op syutod sao mod asin 4so gidap 
un ev soddevid uo oseuUo]NURYs9 UN 4Ip yuoWONY ‘sorquioU 
-9p JOS BUSA op sjulod spuvIs soz sno} ‘oquUOTDOIaS 
guyedrorunur oun sued ‘aisap auennap ap aspuuojpyunyosy 


‘gasop Jomusid 
op osepUOS sp suOTORY, sop ndjode un suUOp ¢ NROTQe} IT 
‘ayes onbeyo suep yuouuepusdspur yssy_ Jed sosuuon 
-O9J9S JOS Ad sag ‘adap saiwadsd ap ASDUUO]/YUDY IT 


‘uoneindod ma] ap ayjte} ey soide .p sind ‘aytyedio 
-Tunut onbeys omjysuod onb sonbituou0s9 soroyds sop jo 
somjoojoid sap UOTOUOJ Ud PIOgeE.p ‘soyeNS /¢¢ US sonedal 
JUOS 19 Yd Se Wwouroy soyyediommur say ‘uoyvoyyo4s 


: JMS SUIUOD SUUNSSI 9S (661 2P dNALI 
suep 9SI[qn soidop sinoisnid e ayyeNs oseuuol]Hueyos J 
‘dNd.1 op suodde 
Sd] SUP SOSNIOUT JUOS TLIOLIN}Ssod ev suoneOTeYs sMoisnyd Ins 
sogpuoy oyWuenb Jed suoneusa sosnoiquiou op 3a ‘asdyeue 
9109 suep JoNUAsse sfOI UN onof osyHUeNb Jed UOHeUINSS,T 
‘SIoseUdUO.II[a sploredde soy 39 SyUDWID}QA so] ‘syUOW 
-[@ So] SUWOD “UONeWTUOSUOD ap suatq xnediourid sap 
xd sop UOTJVULIO} v] JosATeue.p 3SO GNa.] op Jndelqo 7 


uoder nv 166] Ue s9U0UI 
XLid sa] Ans speuoneu sjgnbuy.] e uoNvoyddy ‘s 


ell 


€08 sot Lbs 0°88 oso 79 060 
r'€8 Col LOST 8°L8 CrO” “<eco- SL 0 
O'€8 OOr LPI 7'L8 LEO Sc. 090 
CE STE 61 Ic Css 0" 1C9 SCO 
C18 Sonn ls ae Lis Iso Ors Or‘0 
(% 06) % (% 06) % 

oINISAno) IND) uo sTerg oiINIsAno) AO uo sTetg oyyuend 


ina, qd, 
06'0 19 cL‘) ‘0S‘0 ‘S70 ‘O10 
so[nuenb soy inod “a yo 84844 ap sayotidorg 
Z neayqe yl, 
‘soyquenb say mod sours 
R] op UONUIT}SO,,. SUBP dOUdSIOAUOD op doUasqe UOS op 
asneo & “ue}IOduT sterq UN ymMpoid yUSWIAMdTIO}x9 Sor9puod 
opruypor! np spoyjour vy onb sipur} ‘sgoxo Jed steiq Jos9] un 
d0AB ‘S}eI[NSOI SUOG ZaSse,p DUUOP F_qy,] 9p epoujsut ey onb 
SUOAOA SNON ‘Soue[IUIs yUOS ¢ ‘9 =d puenb snuajygo xno0 
onb sored ‘Zz negjqe) ne souinsor juos [{9=d puenb “4 
yo *444 mod syeynseJ so] sfnog Uone[NUMIS ve] ap sUOTNDXO 
000 0S ep udadsour ne sayao1 WOW sop uoneurxoidde 
aun suoud}qo SnON ‘UOHR[NUIsS eT op suOTINIaXd YOO S$ 
= § sop sunovyo suep dens}oog sonbyjde1 0QS = g suosTyyn 
SNON “u‘“‘T=1 Inod ‘QT = Ww 12 OOT='W ‘OE=4 ‘00I 
= N onb suosod snou ‘oynuenb sed uoneuwnso., mog 


gjguenb zed uonewnsy” = ¢*p 


‘onel gf sed uoTeuNsa,| nod (a)joq 19 INO ‘T oans1y 


‘Q]QeIISAp o]JoUUONIpUO. g}9LIdo.1d 
oun Moar squios gqgqy.] ‘ouog ‘sed yey of ou % onb 
sipuey ‘a yo “a oum0o onsed opuesd ud ‘a]]991 WO. | 
ys ®444 gnb suod0A sSnoN ‘(GIR6] ‘eT86]) Puepequing 
yo y[eAoy Jed osyyn myoo ke aqeiquias yso onbrydess 
YJ ‘Woursess gov a] SuepP dSNjOUT 34sd DJIOI WOT 
‘¢(=d mod ‘y/yY osadnoIis suusAoW eI op UONOUOJ 
ud (ueyodun yHeZou sierq un oyuosaid jI.nbsind “4 nes) 
JOULLIVA RB] OP INo}euINsd onbeys mod saednoss souusAour 
soo ojuasoido1 Toms ey] ‘ooURLIvA ke] Op mMoyeUIsSO 
onbeys op suusAoul ey gynoyeo suoAe snou ‘adnois onbeyo 
Og ‘o7e39 ae} ap sodnoss YZ Ud sUOTINDEXd soy NIed9I Yo 
X/X Uojas uoryenuits ek] ap suo|Nd9xd YQ | Se] PUUOp.1O 
SUOAR SnoU ‘soT[ouUOnIPUOS sqotdod soy JoIpME,p UITY 


900Z aiquiadep ‘ajanbue.p senbiuyoe | 


98 670 L8‘0- A 
Z‘08 6€0 Sg‘9z— Pq 
5°98 670 bL‘0- ae. 
S98 ce0 9° — Boer 
9°98 870 L9‘0- % £0 
7°68 oc'0 6£‘0- ae 
S08 6£0 Ss‘97— Pa 
1°68 0¢'0 Ec0- Wes 
6°88 Tx) 79‘0- nee 
768 870 OL‘I- % 10 
(% 06) 
amMpIOANoD IK?) o% Ud SIeIg d 


vA Inod souelIeA B] Op SINa}eUIT}sa sop uOsTeredwI0Dd 
J hveo[qe lL 

“SOIOOIPSU 
syeynsol sop ouuop sIoy eT & Ad oun,p uorssosddns 
doAR oyruyyoef oT ‘anbidA} yso mb 990 ‘osvuUOT[HURYINOI 
sues sopoyjoul sap mnjao aonb 9aaj9 snd nod un 4so oseu 
-UOT[HURYDIEI Ip SOpoyJSw sap (Ad) UONSIIA op JWOTOYJI0d 
3] onb ayda0xo ‘suog 39 safqeieduio0d syey[nso1 sop JuoUUOp 

rua yg (4 604 «8894 onb | neajqey ne suokoa snon 
“OATILIAI DoURULIOJ.Iod 
INI] IP SOINSOU SUUTUUOD ‘0% YG B DOULTFUOD Op Sd|[BAJOJUI sap 
ainzJaAnood ap sonbruduns saytiqeqo.d say onb tsure ‘souelieA 
RB] Op SIMoyPUITSd SIOAIP sop UONeIeA ap yWOIdTJooo 
np jo oseyusomnod ud JiyejOI sielIq np oped WOW Op 
SUOTJCUIT}SS SOT SUOSTITHN snou 39 UONL[NUMIS eT op sSUOTNDdXa 
000 OL seide.p soyjool WO sop uoneurxoidde oun 
SUOUD}GO SNON ‘UOHeNUIS ev] op suOTINDSXd COO | = SOP 

sunovyo suep dens}oog sonbydor OO = J SuOsITHN snoN 


(9'b) (D4 (1) = Ca 

OULIOJ P| OP ((9°OT 8) UONeNb? 
‘(Z766[) UPUNIOIM 38 UOSSUSMS ‘Tepes MOA) s]Opour 
Jed 9\sISse SOURLIVA BT Op INOJeUISS UN Issne 9}SIXd [[ (Pp 


en (= Gel 19 ras aed T= Os 1 adn 

suep f gun] 9p uorssoiddns red onusjqo apport 
moyea opnesd ,/1 ey 4s9 ex. 1 AdN.{ ep worssosddns 
Jed onua}go apport moyea opnosd 7 ey 480 si no 


(Cy ie Wes qee yey 


Ry le Keo 7 (f-D= Cpa 


OULIOJ B] SNOS SALIOP 3.9 
ynod osevuuoT[HULYSS .p soIsop xnNop say mod uoyd0109 
dun pusiduos nb ({/6]T Yyeys 39 ssojAeg “WOs[O JOA) 
JUDWDIMALI}Xo sIaspuod ayruyyoel oy Jed mayeuryss uy, (¢ 


uy OUI = OXF 39 TaN of PI 
op uoneuIUTs | soide gpnoyeool moyeumnsa,| yso {4 ‘& 00 


(rr) *(O%- omy 7(f -D= Cp" 


ansojejeo nv GqX-[00-ZI1 oN ‘epeueg onbysyeis 


QOUNp 389 91109 JUSUUTOIOTIUS 
sed sou [IS suo osifyn siojsed ‘oisop soruoid 
op osepuos op uonoey ve] mod 980d sIoj BF] & AdQ 
oun p uorssoiddns soAe ofruyyorl of red moayeummss.T (Z 


(r= ‘wy xy) "(= 
9 W/'u= "YN /U= f nO 


1 1 


Uu 
[-4 u 
Ce hae a 


Q10U9p jSo doURIIRA PI Op onbissejo mnayeurnsd.T (| 


(4 


(€'p) 


7N = (")°% 


: 9}X9]U09 o]duIIS 

99 SUEP SoIQRSI[YN OURLIPA eI OP SIN9}vUNT}SO,p sIquIOU 
UIR}INO UN SUOISPIsuOD snou ‘UOsTeIedtIOD op su xny 

x FR ay WA) 

= Tak Me 1 A) = EO IRC UN) AK 

alias yg His Chea Nee" Reed GN fet 

‘“< sap uonendod op je}o} of so MX! ce = ¥ 10 


us 

a 
‘uonendod op je}0) np ones of Jed mo}eUIT}sa | SUOISpPIsSUOD 

us "T= 1 IY “E= uw 9 OT = 'W'SI=4%0S=N Hos 
onvl a ied uoneUsSy| Pp 
“UOT }eTNUITS 
Jed opnmja,, op suo] ne 4no} 9ST[IN jso Sosop xnop ke 
USSVAI? T=9 © 0= (EON 0=9 OL=9 ‘00T=7 B 
Sox] JOS sonourered sap smoyea saq “(p/ 20) N ~ *2 no 


sisi oT SOI GeeresT =) vok ENG, ta = UL 


Jed onudyqo jso 1 oddeis ey] suep y 9y7UN | 
ap "4 giqio sqeuea ey “(d/,0(d-1)‘O)N~ “3 no 


(I'p) Ge lrg pemety Bety Tow e B 


yo ON 


‘Cubadag + =x 

Jed o919098 
yso 2 oddeis vey suep y gun op “x omerrxne o[qeLies 
eB ‘sing “N “7 ‘T= mod (9 ‘N)N ~ ‘nd red a9i9u93 
yso 1 oddeis ve] suep soulelixne sojqeuea sop suusAOW 
eR] ‘JUSUSIONWUOIg “G@qy.] op osepuos op ueyd a] ns sogpuoy 
sqotidoid soy JOAIOSGgO.p Ue UOHRNUIIS ev] Op SUOTINISXO 
So] soyno} mod oxi onuayureul sd yo yIns mb ampgooid 
PR] UOSS sdJOUNS 4so salFHeNSIUN ou UONe[Ndod ou 


UOHLINUNS LT Ip sfVigUasS UONdLAIISIG =['fP 


‘OJe.QS a[Nas oun & SUIT] Snou snou 
yo soisap xnop & YSSV_ UN suOISpIsuod snou “Jods 
mog ‘oyQuenb sed uoyeurnsd,| op 19 ONRI | Jed UONeUITSO | 
op seo os] suep qqq,] Jolpme mod sogyu] suonelnuts 
9p WONNdExa,| SUOALIO9P snou ‘UoHoes ayuasgid eT V 


doneynuais ied opnjo OU, “Pp 


seiBep sunaisnid e ayes aHeuuo|UeYDS | JNOd I\;nNOWEg adA} ap desjs}joog : eplo] ja JayIS ‘Obles ‘eyoeuny CAE 


ongsoyejeo ne GqX-[00-ZI .N ‘epeueD onbnsneisg 


‘OMeTTUIS 4So [eI9UIS GAA.| OP 
O9IJIPOUT UOISIOA 91)90 op oanoid eT ‘[T‘o] > “<b <“d onb 
Jaquour jnad uG ‘ssquUONUSUSNs suonEeNnbs stoy sop nor ne 


tb) Ld ig ees ut adh ce 


(6'¢) a, | 
(es 


— (7/1 +) =" 


Bf) MoE IL ft i= ad 


Jasin Jo [eUISLIO UOTTWURYDA || 
op oyun oun juowoNoyesze jyueUddns ud yeprIpueds 
d]quiasua uN J9910 ynod UO ‘[eIoUSS G_7.] SUeP soMojegTe 
SOIQUIOU op SUOeIDUNS soy oIINPol op UIpY ‘spuRIS jUOS 
SayeS op siquiou a] (No)ja UOTTHULYDI,p safe} say onbsio] 
sduia} sp dnoonevaq Jopuewiop ynod mb 90 uowoAnsadsal 
(9'¢) 19 (s'¢) “(p'g) zed souuop yuos “Yu yo “Mb “td 
no ‘puosas ay aonb snjd ap somoyegye sorquiou ap suonel 
-9u98 {(t— %) (RMB IR td + ({- Mu) 4d +({- "W)} "XZ 
‘quudhOUl Ud ‘oyIssdoou JoTUUOId a] onb 4so asoIqe qqq.] 
B JUOUTOAeIedUIOS [eINUNs G_7.| Op JOTUsAUOOUT UL 

(986) JayUaYOS J UIgnyYy ap UdIsoAeg JUOWOA RUT XOIdde 
dens}oog o] SdAR soye[WUIS sop ajyuosoid ydao0u0d 39 
‘9sa1qe GAaA.| OP S[qesteyur | B JoIpewior nod juouraydunts 
yepipueo ojquissud un asmuopuel jeisues gqqy.T 

‘sonsoyeue 
JUOS SOMSLID}[N SUOTSUD}X9 So] ‘o1sOp sWOLNeNb op asepuos 
ap uonoey ej so "Sf 49 oxBop oweLnenb op uoHUeYD2,p 
aye ey iso “3 no ‘o8oige qq_q.] suep seoxjdwo1 no 


(go (9 epi ce (cee 


(L'€) 


Gas 1, (1S — 1) DL AE US dace 


dIqeqold ey] SOA ONUDJOI 4SO Y 97e.NS B] SUP 
gisop swomenb ne q4Q oun ‘soidop anenb e aynens ued 
un mod ‘a[duroxe Jeg ‘soisap sion op snyd yueyJoduros sueyd 
sop & Gqq.] op oyooidde | ampusjs .p oployyip sed js9.U ]] 
(1007 JONI 19 OVS “osTeg oA) sogyndum 
ajonbua p sosguuop sap ev omeye e uo onbsio] s]qQersop 
ong qjnod mnb gyoudoid ‘Teulsuo UoTMURYDE,.| Op da]J20 
B o]ed9 4S sonbrdor sop ote} Ve] “Gq” sopoyjour xnap so] 
suep ‘yso snjd mn?) ‘UoT[HURYDE Pp sayQueNb soy mod soueLIeA 
R] Op ajUSIOAUOD UONeUISd oUN ISsne yUasInpold sjI 
‘uonendod ev] op uonnsedss op uoNoUoj ev] Inod sagtidoidde 
Mendel op suoNIpPUoD sop snos ‘anno ug ‘seuss 
uonendod op xnvj0} sop soassi] suoyoUoy soy Inod soueLeA 
BR] Op aUSsIOAUOD UONRUISd oun jUosInpoid yeIoUas 
dda.J 19 gsoiqe gqqq.J onb sonuow suoanod snon 
‘JEpIPULD S[QUIDSUD UN.p dTOJeITe UOTOIIOS PT B DORIS 
soyuN sop yuowsoR[duisl oy suep omeyuoustddns uoneuea 


LLL 


oun juesinponut ua (4)a onb puesds snjd ( 4)*4 “yeu 
aipudi suoAnod snou onb jso yeisuss q_qq.] oP 9[9 UONOU 
BT (4a > ( Oe xeu sind “ u> lf ig *s(_u—])_u 
= ( ng ye W °P4 yeu » O=( Ori Pura ‘ouog [10] 
d[eAIQuI.| suep d e yoddes ted QULSSIOINOP SUOJOUOUT 4S9 
(4)*4 aonb suojon (I-4)/ (4 -'4) 'Z=,8 no “(,d-p),s 
4-1), 4=( 44 aonb sJanuoW suoAnod snou ‘sioTy 
TL‘0]S4 oneniqie gyyiqeqoid oun ooae 989iqe qqal 
snos deysjooq uor[yueyo9.p ouusfour oun A jog ‘oyeNs 
gjnos oun suep oidop un & YSSV_ UN suUOISpIsUOD ‘sagpI 
So] JOXIT Mog ‘dJURAINS PY] 1Sd [eIOUSS |__| SUepP JepIpULS 
Q[quiosud UN.p sMOegTe UONSIIEs ve] JUeTYNSnf uOsIel eT 
| 
‘Muy n[{‘Q]a “us“b<'d onb MOA ap afory 3so TT 


fiy 


{r-% 
“cq=y Main} op med e presey 
ne souuOdeTas oyNe oun Jed JooR[dural eT (FJ No 
eG Reape sae 
Co) TF Tt 
ayiqeqoid ey ooae deys}oog uOTWUeYDA | 
suep Jopies ev] (9: 1Y Adn.1 suep fy asnd 
suep yfy Gan onbeyo mog {{- “Yo ‘Z 
Pye an} Jed jyepipueo = ayquasud | 
ous “4 qdN. suep fy qsn.t suep q4an 
“1 soy wed ostuter done Syq sed qqn t— “%7 
Jom ‘yy odeyay e onuajor fiy TUN] Mog ‘II odeyq 


(9°¢) fe 


“al odej9 | @ Jossed ‘(9 ysa uoldo J IS 


AVS ue ecelae “aIsn} op Ined e presey 
ne ssuUOTO9I9s oNNe ouN Jed Jode]duIEI BT (P NO 
= hp ’ 
: el _ Mh 
CO Gay TT 


aypIqeqoid ey saAe de.js}ooq 
uoyWueyoS | suep Jopres ex (9 : 7 advo] 
B onudyol 4 adn.l bis fy ASQ enbeyo mog 
‘(Teta eter Marca) aed, lerepipueo 
a[quiosus,| Jojousg 14 qdN.i suep qsn “Mm 
So] tured aster doAe Syq Jed ASQ ([- “u) 


Jom ‘jy odejoy e onugjor 74 UN] mog ‘JT 9dejq 


‘II odeja | & rassed ‘(2 Jso uondo | IS 


{T- we'e T= 22" qn} op ansed e presey 
ne s9UuUOT|N9T9S o.yNe oun Jed J990R]duaI ey (q no 


“u—1) is 
‘Cy =p DT 


ayiqeqod ey cone deys}oog uoyHULYp? | 
suep Jopies ey (e :Yy oyeNs ve] op uOTMULYDS | 
suep 1 qd onbeyo mog ‘{[- “wi 7 T= 
“adn} ed yeprpues sjquiesus,| 19}0u9q] 


(r'¢) —[= ‘d 


9002 eiquiaoep ‘a}enbue,p senbiuyoe | 


AS T=Y4 ‘wolHuey9, op qdn “uv soy 


Tuused ostwios 90Ae Sy_q Jed q¥qn ([-“u) Ny |] edeyq 


jei9ues qqa 


‘gouonbesuos ua “Yu <b id 

rosueyo jo odey9 onbeyo soyipow suoanod snou ‘zz “47 

“uu someniqre seo sot Joyen mog *“uz"f onb 

oMessaoou 4s9 [I ‘ojduioxe reg “f ‘7 ‘y A[T ‘le 5M, peb fid 
Is onb o[qeordde jso.u osoiqe qqy.| onb mejo jso I] 

‘UOISN]JIp spuvIs B SOQUUOP dp SIOIYDIJ Soy] Suep oINJOUT 

so] op 19 densjooq onbydex onbeyo mod “um o8euuolyn 

-ueysee1 op spiod op syquiasua un 19919 op oyonbua.p 

a\sIsojopoyjsut ne joutted ejay) g Jed % Joov[duia1 op 

a[qissod sa ]I ‘seo sop yednyd ey sueq “g/ 6 9h pee %9 no 


‘a/ (0-49) <= (g)% 
d 


asiyn uo yo “9° “lg 
mmuaj}qo mod ‘g ‘sioy op siquiou pueis un [I] ®& | sadeyo 
so] ojodo1 uO 4Ip JUWIONNY ‘opeD BUOP, Op UOnLINUIIS 
Jed onuajqo 3so densjooqg af Jed soueleA ev] op uoneW 
-so,] ‘JuoWoyfenjiqeyH ‘sseuUO][HURYD901 op i ak 
eB] snos soueleA ef auasoidor “4 10 (A)O= no 
(0) ‘4 = (8) 14 yso densjooq 9] sed (Q)A oP cea J 
yp “iM oe = Ma no pepe ai A He = _A 380 dens}ooq 
3] Jed [e}0} np “uoReUINs9 | ‘S10]e <densjo0q EN eI 
suep oinsy yy \1UN J onb stoj} op s1quuou oy * PO HOS 


Y HENS P| Op 14 Add 
suep fiy aSn.d suep gan “7 soy tured presey 
ne s9uUOTOe]9s one uN Jed JodR[duIaI ey (GF No 


Ciro ta 
Kian pepe Te E 
Overies aes 
auyiqeqod vy dAv de.ys}oog UOT[HURYOS | 
suep Jopies ey (9 :y¥ ens ve] op Y AdN.l 
suep fy ASN.1 suep yy FAN enbeyo nog 
TH odej9,]  sossed ‘(9 ys uondo | IS “y ayes 
Lop 74 AdN.1 suep qsn, “we soy tured presey 
ne s9uUOTSNTaS ane ouN Jed J90K[durSI e] (p no 
pl at 9 
CF-p fi: 
ayiqegoid ey coe deys}oog UOT HURYD9 | 
suep Jopies ey (9 : ,odeja.] B onUd}JoI Y oyeNS 
eT op 74 qd. suep fy qsn enbeyo og 
‘Ty advo] & Jossed 
“(ev so uojido | If “qqn “u soy tured presey 
ne souUlOT}OTIS o.NNe oUN Jed JooR[duIsI eT (q No 
(a=) 


< é As = 4d 
(1'€) Fionn 


_ M4, 


TH edeyq 


(Z'€) calla 


Ty odeyq 


onsoyejeo ne GdX-100-ZI oN ‘epeued onbysneig 


oyIQegoid vy saAv deys}oog uoTHUeYDE || 
suep Joples et, (@ 2 7 y="'y sens 
eR] Sup “74 “‘UOT]HUeYDS.| 9p Aq onbeys mog 


959.148 Gqa 


‘Todeyq 


“SONOLJIP $90 JOPIAI,p Joutod mb syesgues snyd ourtoy oun 
SUOALID9P SnoU ‘sINg ‘Sd}IUUI]T soUTe}ID0 ayUNsaId uonrordde | 
yuop ‘ojdums uoIsIsA oUN oIMponuT sed suodsusawUIOS 
snou ‘sagpt soy Joyidurts Mog ‘soisop smoartsnyd ev deys}ooq 
un suosodoid snou ‘ojeys oun suep soidop simorsnid 
Be oseuUO][HURYoS | op uoNsonb ev] JOVEN op uyYy 


gsodoid qnoussg od4} op de.ysjoog = °¢ 


‘(6p 1-8r1 sosed ‘7661 


UPUNIA\ 9 UOSsUEMg ‘eputRS) (1 ™%7)/ CMa — MA) 
I= os a ‘ac YW) / K- fy tr) ! i l= ies (ju 
CEM) Bet) =f Mya =f tN N= Mf 
a Ole my x sing hi ! OS tu = “4 ses tu = 4 DOA 
fy [=f [=2e 

/ ul Uu 
ai me 1) si <a ONT CC 4N 
May jai ihe “yy 
#12) alt tT ee TPA TS ee aay (“x)4 
BOL AD Sy "N “SCP DIN : 


no “(ina ly =(4)A 

so ( A)eA op siviq sues uolyeuUIsd oun ‘T=1 Mog 
My MC Cu tN) = Mn no UKM HZ 
=X UOJ kL] SNOS AILI9,S ynod mb 90 MN ¢ I= sak 


MD = go MAE =" 0 
[= 


I=4¥ 
SB KC in) | Kes AOE 
H H 


: 1Sd STRIQ SUBS 


INICUINSS UOS “TOT ° rer A One A g10U9p S90 uonenagoe 
ap xnejo} sop moor oT {yo [sy (Mac fal 
ep chirp rin iestetp = yee te) sono ‘(S)9= Q sed 
QUITISS yuoUOTToNyIQey 3s9 (iio “Taye Tal 
MNO TTS ZT 1=4: MAM=S no (S)e=0 
yoIQUI.p uonendod op onoweied ay ‘yoWDsANoOodsol 


‘qdN.P onenbys] 19 ASn.P enenbne] “Adn.P snenbng | 
‘qens op oyenbyne., wos yy SIMOLIQJUI SadIpUT soy NO 
«(re EE HC) = MK red gquasgadar yso sgyun sap 
SonbNSLI}OeIVD SOUTLIIDO Op SOINSOU Op 999A UY “YSSVA 
qed y oyens ey suep “7 aye op 4 Asn. oP aah eB ou 
-UOTD9]9S 180 (GAN) eseuUoTHURYOS,p soyeuy soyrun “7 op 
uo]]MUeYSS UN ‘sIsap SWISISION NY YSSv_ Jed y aes ey] 
suep “WW ay[le} op 2 Ad/A.1 Op Med v guUONeI]9S ySo (AS) 
aSeuUO]]HULYOS pp SoMepuOodes soytuN “ww ap UOT[HURYDSS UN 
‘gudop ouigtxnep ny “ui =u so qdN.P vorMuey? | 


soibep sunaisnid e ayiyesys aGeuUO||IUeYDS,| INOd |||nNOWWAag 9dA} ap desjsjoog : eplo! ja JaIS ‘Obles ‘eyoeun4 OLL 


‘uoder ‘QT S8-[ LE eUUND ‘TYyseqorpl ‘oYysTyeueIy p-Z ‘AVISIOATUE) BUTUND ‘sorpnjg UONPWIOJU] 
pue [e1oog jo Aynovy ‘g1oosse Inassajoid ‘epioy “L ‘epeueD ‘9ST VSA “O'd ‘Aqvuing ‘AjISIoATUA, Joseiy UOWIg ‘s0UDIDg [eLeNjOYy pue sorsneig 
jo yuourjiedag ‘massojoid ‘1oyIS “yy Suoder ‘QS08-69T ‘OAYOL ‘nyNfurys eposeMIYsIN [-9-] ‘AJISIOATUA) epaseA\ “SOTUIOUODY puke ddUDINg [VONI]Og 
JO [OoYDS ‘Inassayoid ‘oBteg “Y ‘uoder ‘1 798-06E ‘OURSEN ‘ojouINS}eP] ‘TYeSY [-[-¢ ‘AJISIOATUA, NYsUTYS ‘sorWOUODY Jo Ajynowy ‘Inassayoid ‘eyoeuny “fT 


ap oyeio) oie, ef yo ‘4us Susu red sagousp 
yuos oyens onbeyd suep uoj[yueyos.p soyjie) soy ‘ayes 
onbeyo suep juowwuepusdgpur 9m 3so qd.P (ASSVd) 
QsTUIOI sues o[duris omojegie uoTyUeYyDS UQ “N= “NIX 
‘quop ‘yuowaanoedsar ‘qqgQ 4N‘‘°N ‘A JURUD}OD 
sojueyoneasyo uoU sajoys FY Ud sQUUONORY 389 (qd) 
osevuuolnueyse .p someulid son Ay op sonjynsuod ‘oruy 


uonendod vy ‘ayneys omoyegye oseuUol[HURYyoS | sued 


SJ1SIP SIO] B IHe.YS oseuuoTHueyIy °Z 


“SUOISNTOUOS SoU sUOyUasaId 
snou ‘9 uoNdes BF] & UUW “qNq.J 9p seouuop xne qq7_] 
op uoneordde| suonsni]! 19 L661 9P dNA.J op eseuuoTN 
-ueyod .p urd a] SUOALID9p snou ‘¢ UOTOES BP] Y ‘UOHelNUIs 
Jed spoyjour ev] ap sayatidoid say suorpms snou ‘p UOT}OOS PI 
V ‘Gda.p sodA} xnop suoALogp snou “¢ uoNdes BP] Y ‘soisop 
sIon B oHeYs oseuuo][Hueyse | Inod uoyrjou vy] suoquasoud 
snou ‘7 UOTNES RT VY JURAINS J] 4Sd DONIe.| op ued oT 

‘JonsnNy]I | mod uode np (qNq) Xld say ms oyeuoneu 
sjonbuy.| ap sosuUOp soy SUOSITHN sNON ‘T][MoUINg op Io] 
oun,.p med ev aseuuo][HURYdE | & DOULTQUIDSSOI BS op asneo 
® (qqq) Wnouseg od4j op deysj}ooq suojadde | snoN ‘aisap 
onbeyd & asiyyn yso (Syq) oTdums oMoegTe os euUOT|HULYDE 
un sjonbsay mod seo soy] yuoUTaIORy Joye op youttod mb 
des}oog np spoujeur ay[aAnou oun suosodo.d snow ‘ajonse 
juosgid a] sueq ‘asevuUOT[HURYSS .p snyd no soisap sto. inod 
9}STX9 U ofdutis dens}oog np spoyjour sunone ‘sayqevosijsou 
sed yuos ou sisap JomWoId op osepuos ap suonoRy soy 
Is Guepusda, (886T) NM 3° OBY MOA ‘sayesout sayIqeqoid 
JAB INJ9d INod 39 (QZH6I ‘CZH6T) JONIS MOA ‘oisap onbeyo 


‘uoTROyNeNs Saseuuo][Hueysgel ‘sanuenb Suorjestesury faxoyduioo aygnbuyq 


® (SV) adurIs onOyege os eUUOT[HULYDE daAR SoIsOp XNop B 
aseuuo][nueyos snos « aseddensyoog » a] nog ‘soyqruodsip 
yUOS s}eJNSoI op siquioU puUeIS suIoW uN ‘so[qeosT[soU 
sed yuos ou 9oidop Jomusid op odepuos op suonoey 
Sd] NO Sk oJ SUR] “OOURLILA PI JOUINSO.p UlJe OSIWOI DAR 
NOI] Nd PAR ]I,S SUIUOD dISOp JoMUSId op osvUUOTHURYDE | 
Joven mod yuastxo dens}ooq np sopoy}ow sdasIOAIp 
‘g[qley yso oisop Jomusid op osepuos op uOTORy ev IS 
(9661 JONIS 10 ORYS “P66I TPH 1° 9pNg 
IOOY *q “CZH6GT JONIS “8861 NAM 39 COBY “AO -8861 
NA 10 OFY {SR6] UapMoUS 39 AYR ‘pR6] URUIpsdIy 
19 JOYA ‘“O<6T SsoIg ‘Issne MOA) (78z7-ZEz sosed 
“S661) NL 32 ORYS SUep d}NSUOD aN ynod aU UONY[Ndod 
ud oseuUOT]HUeYS | Inod deys}oog np sopoyjour simortsnyd 
op oleuuos up ‘soisop smarisnjd e oseuUOT[HURYDS .p 
suvjd soap snos sossi] uou onb Isure sossi] uop[MURYo9 .p 
sonbysye}s sop Joye op youtod ji.nbsind ‘apn yuoworerNns 
-yed jso dens}oog a] ‘so[qissod smoyeuryjss.p owes 
opueis oun mod s0ueLeA ke] JOUNSA,p onA Ud sogsITN 
JO SoquUOp op s]quIasUd | DOAe STUMOJ oNO yUdAned nb 
aseuuo][HUeYyd9E1 Op splod op sjquiasua un simpoid mod 
Sd9ST]IN JUSANOS JUOS dseUUOT[HULYOIEI Op sapoyysu sop 
‘uonbgsuod Jeg ‘SONUUODUT JOS DOURLIVA Fk] OP SUOT}eUT]SS 
SQ] Itu9}qQ0 Inod MAJas os JoyeyNos jreLMod moyzestyIn | JWOp 
SMNDJCUISS sop soalanonsted souLloy soy “UOIsNyZIp opus 
eB sagUUOp op saquiosud say mod ‘anno uq ‘ajqissoduit 
MUU SIIOA ‘oxayduros yuowonbyAyeue 99 nod souPLIeA 
BR] op UoNeUMNso.| “ued op osUas 90 ast[N UO NbsIo] “IO 
‘soisop smoisnid ev synens oseuUO][HUeYSE .p ued uN UOTES 
Sogsl[eol JUOS d]JOYO9 spuvIS ve soyonbua sasnoiquiou 3q 


uononponuy “| 


: SQJO SIO! 


‘uoder ne /66| Ue souoW xd 


Sg] Ins sfeuoNeU sJgnbuq ,| e sJeTUIap oy300 suonbrydde snou ‘uoneNsny]I,p oy & 4a apoyjoul ve] op sojotdoid soy Jonyeag.p 
uye s9}IWUI] UONRNUTIS Jed opnjg oun suojuesgid snoN “deys}oog uoTHURYE,] s1IM.sUOD Inod saguTUUJaJ9peid soyITIqeqoid 
Sop JuRsI[yn us oseuUOT[HUeYSE .p sisop onbeyo e sseuUOT]HULYDE,p a}TUN oUN JOOR]dUIOI op NO Jopses op so oyediouud 
s9pl.J ‘suonvor[duios op doy sues sseuUO][HURYS .p soisep op oiquiou jonb oyoduit.u e JUOUIOTIORy onpud}9 oNQ jnod 
IIA “Sodus vs ev JUdT} SpoyOW BI Op 9OJOJ eT ‘SdssI] UOU onb IsuTe sass] sINa}eUUISa soy Inod soueLIeA k] Bp sajuasIaAUOD 
SUOTJLUIT}SS Sap JuoUUOp nb sseuUOT[HULYD9E1 op splod ap s]quIdsUD UN }UMO} spoyjsU eT ‘oIsap onbeyo ke gsIyNN j10s 
OSTUIOI Sus o[CUIS SIIOJegTe OSeUUOT[HULYDE UN.Nb UOTIPUOD ke ‘sopuRIS JUOS OBepUOS ap SUOTIORY, So] NO soiBep smorsnyd 
® sayneys sueld sop ev s[qeordde yuowoyiory 1]Jnowlag odd} op deys}oog ap spoyjsu oun ayore joo suep suosodoid sno 


SUNS yy 


, Bploy Wons |, 39 1931S “Y ApuLy ‘OSsIeS IysoI ‘eyouuny orn y 


S91sap SInoisnid v IHeYS ssvUUOTWULYDI,| nod Y[NoU.Ig 9d4) op de.ys}o0g 


691 


anbojeyeo ne GdX-L00-ZI .N ‘epeued anbysijeys 
GLL-691 “dd ‘Z .N ‘ZE IOAN 
900Z eiquwadap ‘a}eanbua.p sanbiuyoe | 


‘otered & “UONDIIOSSP [DINSIDIS UDILAULp 
ay) fo poudnor “KOAING MOIAIOUT Yeo [eUOeNY oy) UI eBIep 
SWOSUI SUISSIW JO UONRINduN s[dnNY] fy UWsyod Jo ‘DH “SueyZ 
“Wd Som “Td “YD “AL “ueyeunysey “N “ayUaYoS 

“LE-8Z “‘UONeLossy [eonsnes uRoLoWY ‘spoyjapy yowwasay 
AaAdnG UO UOIJIay ay) fo sBulpaad01g sueq ‘~efloid uoHeyndun 
aida TIT SANVHN SUL (8661) “a@d Wary 19 Wry OMT 
“W ‘oreyyT “MQ “Uosuyor “WL “ory-nezzq “Tf “seyeypg 


TRH 29 uewdeyD 
‘DIDG ajblapayynp ajajdwoouy fo sisdjoup (L661) “Vf “Tayeuos 


68t-ELb ‘16 “UOUDII0SSH [DIYSIDIG UII ay) 
Jo pudnor ‘steak +8] Joye uonendun spdyinyy (9661) ‘ad wany 


'89t-7T9p “6 ‘SoUSHDIS [IYO Jo joUsAnor 
UOHRIUMN] SINSOPsIP JeoNsHeIS :uoIssnosIq “(€661) “Ad “Wqny 


‘OUT ‘SUOS 2p AdTIAA UYOL : YIOX MON 
‘sdaaang ul asuodsasuoyy 40f uoynjnduy ajdyjny (L861) “a'd “wqny 


‘06S 
“18S “€9 ‘byLgowolg “eyep SuIsstou pue souorzuy (9/61) ‘a’ “UIqnY 


‘SOT-S8I ‘891 “V SELIG “Galoog joousiis jokoy 
ay) fo pouanor ‘Aprys yeourduia pue uoyeysniyl uy :eyeposor 
asn aijqnd onoyjucs ‘poyndun-Ajdyjnur Suisesjay “(SQOT) ‘df “ovoy 


"TLT-€97 ‘OE ‘algnbua p sanbiuyray 
‘UOTNLS[NAIP ke] OP sJONUOD og] Jo sayUeNbueUT sosuUOpP se] Inod 
gjdnynur uonendun,| ep spueynuis uonesin (p007) ‘df “uy 


TIZ-€07 “67 ‘asgnbua pp 
sanhiuysay = =“sonbyouyuAs = juoworjonsed uolsnyjip spurs 
B SOQUUOPOLONU op soyquiasud soy Inod soualayu “(€00TZ) ‘df “IUAy 


TSE-SEE “Sh ‘SOUSHIOIS 
payddp ‘soatsusyiedAy poyeon Aqfeorsojooeumeyd Suowe jsoue 
oetpres Areulid Jo ys oy} Jo Apmys joNUOI-asevd kv Jo sIsTeue 
uonemndun-sjdyjnu VY (9661) ‘S'd YrAoosig yo “ql “uepjeunysey 


OI-T “61 ‘SousuDIS 
pr1aC fo jousnor “uote UAT] SINsOpOsSIP [eonsHRIs Joy uoVeyndunt 
gdnmyw (007) “a'd “Waqny 1° ‘df ‘Touoy “AL “Uepeunysey 

‘OI-[ ‘UonRIDOssYy [eoNsHRIS UROLIOWIY ‘soNsiDIG DIWM0U0IT Puv 
SSQUISNG UO UOIJIag ay] JO SSUIPAaIOAT SUC] “SOUDIOJUT [ROTYSR}S 
jo uoneneaq :AoAIng oimipusedxq JouNsuod oy} UI sWOOUT 
Jo uonendun ofdyiny (8661) “SD “UyNeg pue “qyy “Uepeunysey 
COT 
-16 ‘LZ ‘ajanbua p sanbiuysa], WoIssais9l op sojepour op souanbes 
oun.p opie, e@ sojuenbuew sinoyeA sop odnynw uoneyndut.p 
g]JouuOIsusUIpHyynuL =onbruyos} uy, (1007) ‘d “IesIOquaTos 
yo of SyAMOORY UPA “Pr ‘TysmoydaT “AL ‘uUeYyjeUNYsey 


onsojejeo nev GdX-100-ZI WN ‘epeurd onbrysneisg 


"8SS-BES “6 2OUAIIG [DOUSIIDIS' (ELS-8SSd :9SIP) wndut Jo seonos 
[eTussuooUN YIM sooudrazuT UonenduN-s[dyny ‘(p661) “T--K ‘Buoy 


"8 “6 ‘asDMyfog JBI1]SIIDIS 
fo pousnor ‘sojdures Adains xodwioo jo siskyeuy “(~OOZ) L ‘Aepuny 


TTI-LIQ “UOHeISOSsy [eonsHeS UBOLIOUTY 
‘spoyjayy youwasay dadaing uo UoljIay ay fo s8ulpaar01g 
sueq {So]qeueA pdoAlosqo je Uo UOIpUuOd yep SuIssTU 
Jo uonendunt prnoys (L661) “AL Uemeunysey io “Wry ‘OMIT 
OT LOP “6 ‘SousTIOIS joIYO 
Jo jpusnor “eyep poyseul Jo siskyeue Jeonsnes (C661) WU OMT 
‘T6-S9 “] “DOMIS DIYSIDIC 
‘eyep poynduui-Ajdyjnur yyw sonfea—d pajyeodor woy soso] 
soUBLTUSIS (QI66I) ‘A’ “Wqny 19 “TX Bus “ALY “HM 
"ELOI-S9OI “98 “UOUDLOOSSP JDONSIIDIG UDILMoULp 
ayy JO JoUANOL “UOLNGLASIP soudIOJoI 4 ue pUe sOoT|sTe}s paseq 
-jJuoWIOW SuIsn ejyep poyndun-Ajdnynw Woy sjaasl souvoyTUsIs 
qjdures-odse] (1661) “AC “Wany 10 “yy “Ueweunysey “HY TT 
‘O7-[ | UWoneDossy yeonsHeis UROLIOWIY ‘soysIDIG DIUO0U0IT 
pup ssauisng uo uoljsag ayy fo ssulpaad0iq sueq “sooueuy 
Joumsuos Jo AdAIns ul uoNRndun sjdyiny (8661) “A'V ‘ToxoTUUD yy 
“6C-EI ‘Op ‘Sousunlg payddy waysks Suniodey Jueplooy Jere] 
oy} Joy uonendun ody (1661) Wied ‘MrT 1° “Ad ‘uehIoyH 
‘601-86€ “$8 “UOUDIOOSSP JDOUSDIS 
uDIaUp ey fo jJbUANOL “sayIsuop JeUIsIeU SuyRNoTed 0} 
soyseoidde poseq-surdiues (0661) Wav Ws 19 “AV ‘puRy[eO 


“ISE-O€E ‘9 ‘spoyjay jooisojoyodsg “soinpsoo1d 
RJLP-SUISSIU UWIOpOW UI solsayeys SANOMSOI pue daAIsnNpoUl 


Jo uosueduios y (1007) “WO Wey 10 “TYP “Teyeyps “WT ‘sulyoD 
‘SS6-8h6 “98 ‘DyLWaworg ‘uonendun-s[dnytnu YIM 
Wwopsey JO ssoisap ojduies-]jewls (6661) ‘A’ ‘Wiqny i0 “f ‘preueg 


‘QE-LT “8 ‘Younasay pooipayy ul 
SpoyraW [PIUSUPIS ‘SANVHN 1 SCTV Wor, :sorpnys [eorpeut ut 
uoyeyndun opdyjnur Jo suoneoryddy (6661) “x “Susy io “f “preweg 


arydeisorqr” 


“SUOT]SABSNS 39 SOILJUSUUUUOD SIMI] Op 
SINDJCUTUTLXS So] 39 JUIOfpe Maoepol 9] JUOTOIOWIOI sone 
so] “Uonepuno S9USIS [eUOHeN BF SP 688Zlcr0-aLl 
asinoq ei ied sgoueuy 939 e& opmo ajuosoid ey] 


SJUIWIIIIAIUIIY 


uoleinduul | suep eHheuuog}|JUeYoS,p Ue|d Np uOHesi|apow e] ep soUeLOdUUI,7 : AauUry Jo UeUJEUNUBeY ‘Je}I0y BOL 


ansojeyeo n& GqX-100-ZI oN ‘epeueng onbnsneis 


(1007 Wey 19 
JQFEYOS ‘SUTTJOD ‘L661 JFeYSS “Lo6] URIeUNYSeY 30 9p] 
‘p66 Sua ‘O[duoxo Jed) soyuenbuvul saguUOp sop UONeEIO 
Op SUISTURDOU Od] d[QeIOUSI sIpUSI op ue uoTenduwt.p 
So]Epoul soy] suep soyueNbuvul saguUOp xne sodgI[oI yUOS Inb 
SO|QELIVA Sd] Soyno} smMyour : sfdyynu voTEndut | yUeUIOS 
-u0d guUOp yUoUUUONbay [eI9UdS [IOSUOD 9] SOJOJUDI IID 
‘SJUSTOYJI09 syyod op uOnPUISd | Op Joy[Nso1 yUoTeLNod 
nb sayovoyjout say yuossedims ‘soyuenbuewl saguuop sop 
UOYLIIO OP SUISTURIOU NV SddT]OI soTqeUeA sanne.p no uryd 
np ‘sojueyJoduit sayqelieA ap UOIsN[dXd J Josned ynoed onb 
sIeIq Soy ‘seo xnoiquiou op suep ‘enb suosuad snon ‘a[gpour 
np uoneoryioeds op Iowa .p sonbsi soy ynpes uoneyndut.p 
SO[9pOU Soy sUBP UOISNjOUI ma] aonb sylos op ‘ojgnbua.p 
sgjqeiea xne sog[atiod yuos urd np sonbnstigjovses 
Sd] JUSANOY ‘SddAJOSGO SIN[VA soy JURYydes sayuenbueuUl 
SINIVA Sop I[OUUOTIPUOD IO] LI JWOUWO[QeuUOSIeI OOP 
mb uonendun.p sjopowl un.p uoneoyioods ve] suep opIisos 
sgoons np 9fd ey] ‘aydypnur uonenduwt,] op seo af sueq 
‘soyqisneyd uou suoneyndui sap souuop jeunod 
afore yuosoid oy suep gsipyn yewuou onbiyoseis1y syopour 
9] ‘oTeUIOU UOU Toy oUN yUdAINS addeJd ap sjofJo soy Is ‘IsUTY 
"SOXYE SJOTJO B sopapour say onb yUsuI9;91O09UT JOIIOEdS soy 
op optoey snyd jso jI-nb ysa sonbryorejory Sayapoul sop JUSTUDA 
-UOdUT ane UP) ‘dYdIOYDOI Op xneAey soy oJAINsInod as 
qUdTeIASp jonbo] suep sureuop uN Pp 13e,S |] “(TO0Z) [Joo 19 
uvyyeunysey op ofjoUonbes uorssoiso1 Jed suonendui xne 
a]qe[quies yids un suep soysnfe ong ono-jnod juoteumod 
sjanuonbes sonbiyoreisiy soyapoul saq] ‘ayqeynopss syoR} 
aun 3sd sonbuosge9 39 sonuIjUOS sayqelIeA smorsnyd smod 
yuonbueul saguuop sap onbsio] soxoyduros os euuO]]MWURYDE .p 
suvjd op seo oy suep sonbryoseisry soyapour op yuouiajsnle | 
‘ISUTY “SOXIJ SJOJJO B SoySpour say onb Joysnle e soployyzip snyd 
yUOS sonbryoiesoy sayapout say ‘slofayno], “so[qeiquuas jUOs 
oddeis op sjajjo soy onbsioy yuowosornonsed ‘sayuenbueur 
soquuop sop uoneyndut., mod soxy sjayjo & sayspoul sop 
onb joynjd sonbryosejsty soyapow sap JosijyN.p xnoseyueae 
ong weumod jinb Jasued e yuouUOp suonRNnuIs say 
‘JOIQUI.p ajonbus .p s[qeLeA kB] & Sdd{2LI0N 
yuos mnb (adders op aie} ‘oyduoxa sed) uonnysqns 
op so[qeliewaA sop juenjour ua no soddeis ap soriosayeo 
sop juvdnoiso1 ua oduoxo sed ‘ued np sajqeuea so] 
suJa0U0 IND 99 Ud s[9poUr 9] Jo1ITduIs yUoAnod smoyndunt 
sg] ‘JURaY9 seo a] ‘added onbeys mod soyeuruou soyqeLiea 
SOP IINJOUT P d[qIssoduut jso [I nb oxayduwos ts ayo jnod ueyd 
3] ‘sojgnbus souleyioo op sed a] sueq “SHNVHN seajenbue 
Sop o[duisx9 | SUBP JR] SUOAR,| SNOU oWUIOD ‘ued np sonby 
-SLID|OBIVO So] INOd soyeUIMUOU saTqeLIeA soy 99Av soatIdoidde 
SUOTJOVIOJUT SO] DIMIOUI JWOIVIADP USS 99 op suOTeI 
op s0ua\sIxo., JUouUOSdnos mb smojyndwi say ‘sastuo 


LOL 


yuos urd np soajueyiodun sonbysuajoeieo sop onbsind 
‘sogsteiq SUOT}eUIT]SA Sop oiINpod ynod PTH NO XY opoyssul 
eR] op uonesyyn | ‘oddess ve] uojas JUOIOYIP sooULLIVA soy 
NO UOISSdIsEI RP] op ojuod vy onbssoT ‘onbyewoyne uoyNjos 
oun sed 3so,U soyeuTUOU so[qeuieA op ojsnoae uoronp 
-ONUI,] ‘Uepusdsg ‘uejd np 9]e}0} 9}duWI09 ud ostd-uOU 
RP] B& JOUWOAneIedUIOD sIeIQq 9] JWOWI|QeISpIsuOD JNpol 
oddeis ap sjajjfo soy] Inod soyeurlUoU soTqeLeA Sop oIM]OUT 

"JUDUU9}OO.LIOD soyToads smayre 
zed yuos uoneyndui.p sojepour soy onbssoy ‘soyuapnid 
2 SoovolJour sooualayuI sap ‘ond ne 4mpoid “SGNVHN 
sayonbua sop ojduioxa | suep 39 g UONeNWIs oyOU suep 
suIUIOS ‘sayuounJed uou ued np sojqeiieA op UOISNIOUT | 
‘smoyie reg ‘JURWodum steiq un e& Not] JouUOp ynod omyoul 
So] op oN}OWIO “VW UOTRINUTIS dOU SUP SUTUOD ‘ajyonbua .p 
so]qeleA xne sog]aIod yuos urd np sofqeitea soy onbsioT 
‘sonbsi onbyeid oun ang ynod odyynwu uonendut,., suep 
eseuuo][nueyse,p ued np ajduioo sua} sed ou onb Josuod 
® yUOUUOp UOTe[NUIs ed sopnye soy ‘sooyuNy onbion?) 


UOISn[IUOD °S 


(IL¢e0-‘vrr‘0-) 6100 LOv‘O— ued np o]qerea op seg 

(69€°0- ‘6rr'0-)  070°0 60¢0- ued np sayqetie A, 
onbstso] UOTssaIsaI : UDG 

(pSr'0 “TSZ'0) 7S50°0 ZS€O ued np o]qeisea op seg 

(L9r‘0 “9S7'0) 7S50°0 Z9E0 ued np sopqeiie A, 
onbyjstso] UOISsaIS9I : QUISTIO | e I9UUOPIO 

(TrE“0 9670) 110°0 61€0 ueyd np a[qetsea op seg 

(6€£'0 ‘667'0) 0100 61€‘0 ued np sayqetie A, 
0900dd ep suUakopy 

% 668 OI rq ouod 4sq 


sog1ous! yuos ueyd np 
sonbrsii9}oe1e9 say onbsioy 39 uoTeynduit.p 
d[2POUI 9] SUBp SosnyoUT yUOS Ue]d Np sonbyst19}9e.1e9 
So] onbsJo] So[[991 SaguUOp sap s}ej[NseI sop uosTeIedui0d 


g neayqeL 


‘uoneNdul p sapout 90 
suep uryd np sonbystigjoe1ed sa] SUOLIOISJUI Snou ‘¢ UOT}DeS 
eR] eB sgquossid suOneNUIIs sop sje}[NsoI sop dIOTUN] 
PR] VY ‘ouuIW jso UOnRInduT,p sjapoul oy suep ued np 
sonbystigjoereo sop uorIsnfoul., mod gyyeusd ey Yuepusday 
‘oddeis op jo ayes Op Sjoyjo sop dANKIOI DOURIFIUSISUT,| 
B 30 Quenbuewl uoNeULosul.p suotjoey soyqiey xne ‘onsed 
ud JUST RI) ‘s}eI[NSOI soy Ms sjoyjo.p sed onbsoid e.u 
uoneNduU .p sjopour os] suep uvjd np soyqeiea sop uoNeIs 
-UI.[ ‘sed 90 sued ‘SoTquIquIss YO} yUOS suOT}eUITSA.p 
So[qUISSUS XNOp So] ‘sasATeUR Soy Sojno} Inog ‘UoHRNdut p 
so1sgjeNs xnop soy Inod sjzeynsai soy suUOp ¢ NeaIqQu} OT 

"Y pororsoid 
np « Adams » souNNOI sop usXow ne ssepuos op urd 9] 


9002 eiquisc~ap ‘ajenbuse,p sanbiuyoe | 


INS sagpuoy sopoyjsu sop Jed soUIysd yUOS sanourered say 
‘% TI UOIIAUD.p jso sqQyURNbUPUT SMoeA op UONIOdoId Pv] 
a]jonbey nod onunuos oyqeuea “CYIdWWACGND e]uey ek] op 
osAned op [INds-NUdADI ORI I] INS YQODOdA op enbystso] 
UOISSOISOI OUN sUep UOHeINdod op UOISsaIS9I OP S}UdIOY JOO 
Sd] JUOS SUIDISION JO OUIIIXNOP SIT °% S] UOMAUA,p 4sd 
g[qeuea 099 nod soyuenbueul ssguuop op uorodoid ey 
'(0900da) [OJ9IS2]OYD op xn} IMI] JOLIEA Wey Blop yuo mb 
uonendod ve] suep souuosied sap o8ejusomod 9] 1s9 Jomusid 
aX] ‘sonouried sion op UONPUIT}Sa,| SUOI9pISUDD SNON 
‘aisaye.ys onbeyo 
Inod saguuop op sayquasud YQ] = o49U98 SUOAR SNON “(OAL 
/duus/ois/MpsyotuUuN'IsTMMM) TLV MAA [elorsoid 9] suep 
sgUsU|duIT aTJaNUoNbes UOISsaIsEI Ap SpoyjoUr ey] JURAINS 
SINOTeA Soy 9INduuT sUOAR SNON ‘UO ndut.p spspour 9] suep 
SOANVOTAXS Sd[QeLILA SUTLUOD SUOTIOBIOJUI Sd sNyoUT JOU 
-[e39 SUOAR snoU 30 ‘ojonbua.p sa[qeLIeA soy 30 soyeUTUIOU 
SO[QLLIBA SO] O.HUS SOANROTFIUSIS yUOUONbIsHE}s SUOTIOR.IO,UT 
sg] Joigdo1 mod saqeiea sop ayjonuonbes uonosjas op 
amMpsooid ouUN 9SI[IIN SUOAR SNON ‘SoAVITTAXS saTqeLIeA op 
dT} & SOTLUTUOU SoTqeLieA ¢¢ “jno} US ‘sNJOUT SUOAR Sno “Ip 
yusUANY ‘ayes onbeyd suep sadjtoquuia seddess xnap so] 
Jojuasoidoi mod aye.ys onbeyd suep oyeurwou s[qeiueA oun 
JO sayeNs BZ Joyuosoido1 nod soyeuruiou sayqeiuea /7Z snjoul 
SUOAR snou ‘Uonendut.p sjapour oy sueq “(Kj SWUIOD) 
soddeis op smoayeorpur soy mod soxy sjayo,p udckow 
ne urd np sojqeliea soy yURISSUI anne] 19 (SYA SUID) 
ueyd np sojqetiea sop ajduroo sed yueus} ou oun] ‘sorsaje.ns 
xnop uoyes soyenbueur soguuOp soy syndut suoAe SNON 
"SO|qeLIvA SasnoiquioU op nod sa9gAgToI 
yuoOs sqwuenbueul sasuuOp sp %OYT & %S 9 ‘Says BZ 
onusa sonidos soddeisg¢ ua sadnois yuos snplArpul 
ST “ZOOT % 6661 OP Sogstfesx SAoAINg UoTeUTUEXy 
UCONN pue yyeoH [eUOneN Sop UOTSNyJIp opuvss eB IOIYOY 
np yuouUSTAOId saguUOp SOT ‘saT[oEI1 Sa9UUOpP sp sTqQUUTISUO 
un suep sajuenbueur saguuop soy Joey nod uoyendut| 


onsojeyeo nev Gd@X-100-ZI oN ‘epeueg onbrysyeis 


ap sso] soddesd ud ost ve] Op Jo UONROYHeNS vy op ajdu09 
ud ostid e] Op JOJJO,] JOUIUeXS JURUDJUTeU sUOTTe SNON 


Sa]][99.1 S9QUUOP sop Ans 9puoj ajduaxy = *p 


‘WH Spoujeut ey 19 soyayduuro0s saguuop say nod gynoyeo 
moo aonb puss snd ompziaAnod op asejus0mnod un suuOp 
Inb 90 ‘Syq SpoyjoU ve] Ap seo oy SuUep JUdLIOTeSO d\SIxO 
NT, suep yuoredde sgoxo sed siviq od ‘o][OO1 SOULLIRA eT 
onb opuris snjd ano ev sourpud} & Xf Inod saumsa souRLIvA 
eR] onb yey ne yuo eI9Q ‘IH epoujeul ey nod jo sajajduioo 
saguuop sop soide.p soynoyed sayfeAtoyur soy Mod sAs1osqo 
asejyusoiod ay onb pueis snyjd yso G yUaIANOD Inb souRIyUOS 
Op So[eAIOUI.p oseyusomod 3 “x4 spoyjow ke] Inog 

‘OIOZ SIOA SUITSO Oddes ap syayyjo 
So] asst] onbrypsesory uoneyndut.p sjepou aj onb sored “yy 
od onb PH Imod giqrey snyd yso soueLIVA eT ‘OJOZ & DOXTT 
ySO MQ[VA INI] ‘Sy _ spoujeu ev] suep onb sipuy} ‘uoneindod 
eR] suep sfnu juoWdaTyeurxoidde jyuos mb sanouwresed 
sop JUOWISd sopoyjour sosomoid xnop soy mod uonyr} 
-nduil.p sajapour soy onb sored ‘gyq ke JuoWOANneIedwos 
soovoyjoul JOS JH 3° XJ onb suodoa snou ‘uonendut,p 
SOISHCS SION soy suoredusos snou Ig ‘saja[dwioo saguuOp 
sop soide p suusXow oyjanjouod uoneunysa | op UoneyNuUts 
op MdLI9 Pp IsIeUl ev] SURpP sostIduOD souUdAOW soT[anjyouod 
sUOTIeUISS sop Juasnpoid PTH 19 KA Sopouyour say ‘somo 
-Ue SUOTIRINUIIS so] suep sUTIOD ‘ajonbud,] op s}eyNsoI 
xN® Sdag[9lI0d yUoUSTqrey onb yuos ou ued np soyqeliea soy 
anbsioy soyqeidacoe saouasaJUr sop IUMo} ynod uonendut .p 
So[apour soy suep doseuUOTTHURYE p uid np ojduw09 WUD} 
sed ou onb ouop syquies [] ‘uoneindod op smjonys ey Ud 
JUSUUD|QeuUOSTeI d19]JOI1 SY_ snos uonendu.; aonb so1ed 
Isule 4Sd Ud TT ‘soya{dui0d saguUOp sop soide.p ouUoAOUT 
a]jemouod uoyeUsd.| op UOHRNUIIS sp INouEp odreUl 
eR] suep sosuiduroo yuos souushoul soy yop soyjonjouod 


Z00°0 Z00°0 ran IT‘0 
700°0 €00°0 STO 710 
€00°0 Z00°0 E10 (a) 
100°0 100°0 L0°0 L0°0 
Sr9l 60°SI 19°TI Sv'0l 
ae 78 °6€ 79°07 aE 
Ol, 6S°€I rally L6'8 
ZE“s Tes OTL ELL 
vr'Ly 67 LY 9161 LL’81 
8ETLI 99°L6 67 87 79°61 
Ie8v $90 761 Sr9l 
99°E S9°TE eL'vl 19‘ 


(ys "IRA) WOW (S80 JeA) eA SO “IRA “IeA 


suoneunsds sop uyua ynpoid sSyq spoyjow ey 
S001 756 WH 
+001 1°96 XA me 
LOO! 7°96 SVd 
r0°0I S‘r6 sojo]dui0s soguu0g 
€0°0 796 WH 
LT‘0 9°86 XA JUISTIO, | 
O1'0- 8°96 SVa BR AQULOPIO) 
Z1‘0 L‘€6 sajg[duioo ssguuog 
970 1°S6 WH 
or'0 8 L6 Xd 7 op ouuakopy 
710 LS6 SVd 
im) L‘v6 sojayduroo ssguu0g 
% $6 
‘ouod "ysq BOF “AN0D spouse 


POOL 1° bI‘O & xnedo jus UONL[Ndod op UOISsoIBOI OP SJUSIOYJOO9 So] 19 PEO B B[e39 So UONLNdod op suUaXoU BT 
}QI9IUI, p sJonbua ,p s[qvLeA PJ B S9g[9II09 VOU JUOWOJONVUA JUOS UR|d Np so[qelseA So] onbsio] UOTE Ndut,p sanpgooid sap spjetido1g 
p nevs[qeL 


uoleyndul,; suep eHeuuol|UeYyos,p uejd np uoHesl|apow e| ep soueyOdUI,7 : AeuUly Je UeYJEUNYHeY ‘Ja}I0y 99] 


ongsoyeieo nev GqX-100-ZI oN ‘epeurg onbrysnei¢g 


O10 O10 96°0 COT 
a0) 01‘0 86°0 €0°T 
9€'0 se0 LL LOT 
O10 60°0 16°0 66°0 
SL‘I6E SI 00°16 v1 ST9EP Sr LS 
79°99 SI IZ‘6€S SI 88'rrr 80°9SPr 
LS‘Orv 6 POET 8 9EITE CTSLT 
EL‘SOE SI 07'SS6 v1 pLl'ter Or ISP 
S89IS 67 19°90 67 ES‘S9V €0'9Lr 
L0°60b O€ $6 80r O€ IT PLy 98°ELV 
rL'y9l TI Or'87Z OT Or COE 9F°6ST 
v0'TSE 67 LL'IOE 67 88° 19h L689¥ 


(ys0 IeA) WOW (380 “JeA) eA 4ySO “IVA, ‘eA 


Ol‘ol €°€6 WH 
Ol‘Ol >°€6 XA esd 
CL 0°6S SVd 
60°01 1°€6 so}9[dui0s sopuu0g 
89°0 €°%6 WH 
99'0 7'€6 Xd SUIBTIO | 
Ole STE SVad B spuUOpIO 
ZL‘0 0°€6 sayo]dwioo soguu0oq 
ve0 v6 WH 
ZE0 L°€6 Xj ‘ 
‘ J op ouussoyy 
06° ‘Te Ae Risley 
LEO 9°€6 soj9]dui0o saguu0g 
% S6 
‘ouod sq BOY AND opounsiN 


CLOT 19 p10 & xnede Juos UoNeNdod ap UOIssaIB9I SP SJUSTOYJO09 Sg] 19 E‘(C & Be39 1so UONe[Ndod op suuaKoW VT 
addei3 ap sjajjo sap uoU ste ‘ayeYs op s}aJJo sop pusrduioo uoyendod ev] onbsJo] uoeyndut,p sompgooid sap sgj9tido1g 


¢ nevo[qeL 


"py neo[qe} 
ne squesoid yuos suonnedss YOO [ nod syey~Nsor say “JUS 
-OMOLIDIUL Sd}LID9P SOPOYJOU Soy UOTSS soyueNbueW soguUOp 
sop jureoio ud 30 oyNeNs soddeis ua osevuuo]]HueYysd .p 
ueyd 9] yuesiTyn usa ¢ uoNeNdog ev] op med & UOTTHURYOS 
un suom snou ‘oyInsuq ‘7 UOnRINdog eI SUP sodIOUDS 
X op smeea sop “°g suoXeysnos snou ‘x Joigues sod 
uourgstosid snjg ‘soddeis xne jo sayens xne souevuoyredde .p 
smoayeoIpul sop sajuepusdspur jsd X op uoNNqMsIP ey 
g]jonbe] suep « ¢ uoneindog » ev] suoigues snou ‘aymsuq 
UOnLINAUIT,p SdTIpoOuUr soy] SUBP SasNpOUT JUOS sayuoUTZIEd UOU 
added ap sonbysiigyoeses soy Is sw9u ‘suoneindod sao mod 
SO[GVUUOSTLI JUOS JH 19 XH Sopoyjou say ‘ouoq *sayay;dur09 
saguuop sop soide pp snuaj}go say[eAJoyut soy Inod a.myziaAnos 
op xne} xne JUSWOAneUTxOIdde yUspuodsa0d sdURTFUOS ap 
SO][PAIOJUT Sop OINZJOANOD op xnv} soy ‘ano u_q ‘sojeyduros 
soguuop sa] Inod saqjanyouod suoyeunjse sap ouudAour Py] Op 
UOHLINUNS Sp INdWO.p Is1eUl B] SUP JUONYIS as soyjenjouod 
suoneUIsd sop souuddour soy ‘WH 10 XA Sepoyjoul so] 
og ‘UoneoyHeNs ey op ajduroo sed yuo ou ajo.nb sored 
‘QOURTFUOS OP Sd][PAIOJUI Sop dIOOIPSU dMyJOANOD oUN 49 
yueyIoduml steiq un smmpoid op snuyUoS SYy_q spoyjoUw eT] 

"€ neol[qr} ne soyuasoid yUOS 
suonnedss QOQ [ mod sjeynsol say ‘JUOWIamMoLIg\Ue s}LIOSp 
SOLIBUZDS SOT JURSITHN Ud sayUeNbuLU saguUOpP sop sUOIDUNS 
9 ZUONLNdog ve op Med e UOTTHURYOS UN sUOUUONDETIS 
SNON “(001 ‘0)N op Aued ke sagiy yuos M> sx OI9Z 
ev “@ yJuexy ud ‘¢ uoyenbs,] sed sauUOp a]j90 onb apoyjour 
UIQU BT SUOSTTIN snou ‘e[90 nog ‘soddevis sop sed puadap 
OU SIVU ‘d}BNS RP] UOTIS DIQJIP { op UONNQuysIp ey o]jonbry] 
suep « ZuoHeindog» ev] SudI9USS snoU ‘UdWdIOMUDIg 


SOL 


‘uonsonb 37399 JoIpnyd .p 
OnA Ud sogsITeoI UONLINUIIS Jed sapnjya xnop op sjeyNsoI 
so] suoyusssid snou ‘UoTas ayUasoid eT Y {SoousJOFUl 
so] Ins uejd np saquoutjed uou sonbysugjoeres op uon 
-PSIJOPOUL L] OP OUDPIOUT.| 1S9 dTJONC) yO19}UT,p sJgnbua ._p 
SOTQeLIVA XN SOdI[OI JOS soJOIWep soo puenb o]jonuUasso 
yso uvjd np sonbysugoeres sop uonesispoul ey 


s9}U9dUIZ.A10d UOU SOATVITTAXa sajquliea 
op UOISNIUL | ap UOHAYSNT]]T > q UOHBMNUIS 7 ¢ 


‘soddei3 Ud SSI BT Op 1OJJ9,] B JTUWIOANLILAUWIOD OIqIey 
JUSIDALIOI Jso soyuUenbueul soouUOp xne onp syUenbueuI 
UOHeULIOJUI.p uoRORy eT 4p yuoWoHNYy ‘vUonRndut.p 
SOTNI[IO OUD DOURLILA PB] & JUOWIOANLIOI JURUTLUOP Md}oRJ UN 
UOT}eINUITI .p SaTNI[I9 so] SuUBP DOULIVA eT Op JO} Inb ‘addeis 
op sjojjo spueis sop asneo ke IsuIe jso Ud [J] ‘sojoTdWIOS 
soguuop sop soide ,p ind} eUWIsSd | B 99TOOSse aT]90 onb apuvss 
snjd yuowo1es9] onb 3so.U PTH & NO XA & d91D0Sse DOULA 
eR] ‘Uoendod sp suusAoul ve] Sp UOTeUISS,| Op SOT 

‘¢ uonenbs | suep sonouered sop 
SOLIS SUONLUITSO Sop yUosInpoId sonbryose19TYy soTapou 
SO] 19 SOXIF SJQJJO B SoTopour say onb sored ‘somes spyoid 
sop JO JH 1° XJ ‘soqo[duiod saguuop soy soide.p soual 
-9JUI.| mod snusj}go xne} xne yuoWIdAyeUITxoIdde yuopuod 
-Sali0d Inb omzIdANOd sp xne} sop xnop sojno} JUOUUOp 
J2 Sqjg[du0d saguUOPp so] IMs sogseq sayfonjyouod suoTyeUIss 
So] ddAR JUOWOANeUTXOIdde yUuapioou0D Inb sayjenjouod 
SUOTJLUIT]SS Sop xNop Saznoj JUasInpod PTH 19 XA Sepoyjeul 
SYT ‘ssousIgyUI soy Inod osepuos op uejd ne podde1 sed 
STRIG SUBS SINIJUT}SS Sap sUOST]IN snou onb yey 9] 9Is[eUI Jo 
onbueuwl UOTeUJOJUT.p nod Is SWIQUI JUD\SIxO sauaTqoid sag 
‘uonendod 93399 suep SOURTFUOS Op Sd|[BAIOJUI Sop dIDOIPSUT 
SO] SINUOANOD SUN JO SOOSIRIQ JUSWIDALIS SUOTJPUIT}SO sop 
yuosinpoid SY_ Spoy}sUl eT Ins ss9puoy suonendu say] 


900Z eiquiec~ap ‘ajenbus,.p senbiuyoe | 


0¢'0 670 o9‘T esl 
810 810 br'T Srl 
950 $s‘0 077 OI‘ 
cho v1‘ cS a vel 
11 ‘00r 61 PT9ST 61 78°PTS T8°9ES 
€£°S89 IZ 9167S IZ g9ISs 61°6ES 
66°966 6 ST‘ISE 6 OS‘S9E 60°0VE 
IZ‘O€r 61 EL“Evs SI €L°66b 1S‘67S 
66090 PE 6£°9S0 PE OT‘ESs COMSS 
OL‘Ivl SE 78 PLP LE 76°6LS 60°PSS 
SEEIO EI L6‘L%6 II pL‘O9E 6L‘LTE 
LO‘9€6 I¢ 61979 TE IE“L7S l6‘bvs 


(389 IeA) WOW (3S0‘JeA) eA = ‘JS “IBA ‘IeA 


ansojeyeo ne GdX-100-ZI oN ‘epeueg onbysyeis 


‘01 L‘S6 WH 
l‘Ol o'r6 Xd 
9‘) 9"b9 sv audg 
Vol €‘€6 soj9]duioo ssgsuuoq 
Le 6 £6 WH 
87 S*v6 XA SUISTIO | 
8°9Or S6E Sva 8 89UUOPIO 
v7 0°€6 saj9[duoo soguuoq 
C7 a) WH 
v7 8°P6 XA k 
; ? J ep suushopy 
8 SD 0 8¢ SVad 
07 Zb6 saj9[dui0s soguu0g 
% 56 
ouod sq BJ “ANON opompsynl 


LOI 19 O’€ B Xned9 yUOS UONLINdod op UOISsaIB9I Op SJUSIDIJOOO soy 19 Z7‘¢ B BeB9 so UON{Ndod op suusXour eT 
}919}UI Pp sJgnbus,.p s]qerIeA eT & SodT[OI yUOS ULId Np sanbyyst9}9eIvO so] onbsJo] UOTeInduI .p sopgooid sap sa}91Ido1g 


Z nealqe L 


“SOOUITISD SOOULLIVA COO | 
sop suusfow onbyeipenb moo. 39 douRLIeA ev] JUOUUOp 
« (‘JSO “IVA)WIOW » 12 « (489 ‘IeA)IeA » sagjonbys sauuojoo 
SOT ‘“soyjonjouod suoneUIsd sop soslsa soouRLIeA sop 
SuOTIHIdSI YOO | S28] INS souUdAOUT Sd] JUdTJUOS « “}Sd “IBA » 
agjonby9 suUOOD eT ‘CO ap sayjanjouod suoneultyss YQO | 
SOP SOULLIVA So] JUSUOS « ‘IBA » dg}oNbyd sUUOTOD eT ‘CO 
op soyjonjouod suoneuNsa YOY | Sop souudXoul so] yUaTUOS 
« ‘ouod ‘sq » sajonbye suuOjoOo eT ‘uoneindod op anouresed 
9] JUOUUAUOS Inb sg[NUIs dOURTFUOD SP Sa[PAIOIUT COO | 
sop osejusomod oJ yuonU0D «%CG B DI ‘ANnoD» 
agjonbye suuojos ey ‘o= ““y eu p= 7 oyjanbey, mod 
oyun sunone nb yuesoddns us omp-e-j}so.0 ‘soquuoy]HueYoS 
sium soy sojno} mod saguuop soy juRsTN ud sjeynsol 
So] OUUOp « saja[dwIod sasuUOG » o9};0UUR sIeyUSUTOTddns 
ousl] VT “| Nea[qe} ne soyo9p uoyEndut.p soisqye.Ns sion 
sop suonnedsl YOO I op Siey[Nse1 soy oUOW Z NKITqQu} IT 

‘p uonenbs | JuesI{QN us y soyuenbuew 
soquUOp op INd}eOIPUI.| SUODID SNON ‘jJUOWOmMoLI\Ue 
Wap snes soddeis uo osvuuo]Hueyos p urd 9] Uoyas 
uoneindod 3390 ap ized e& UoT]HURYDS UN suo snoU ‘sIng 
‘suolyejndut soy suep oseuuoTyueyss.p uejd np ajdwos 
Ud dsId-UOU PB] Op S}aJo Soy] WSSoIs “moj uos ve ‘nb ‘ayduuts 
oMoyeg Te os CULT HULYDO | B JUOWIDAneIedUIOS URI op s}aqJo 
So] IIsso1s op ule sosiodsip yuoursyioy yuos addeis op jo 
a}eYS Op sjajJo so ‘soyuepuodgpur (.0/ ‘0)N Slo] op Aed 
eB smMgeA COOT= “N Op soyquiosus buto jue ua sonuajgo 
juos “@ op singyea saT ‘0OS— = *'d 19 ‘OST= "'d ‘O= “Pd 
‘osz—-= “d ‘00s = "8 yUOS ayes Op sjoyo sop smoyea 
SoT (007 ‘0)N 9p Ased & 91 oMO}eg[e IML ,P SUL} 
un yso 45 40 ‘oy addez3 ey mod omejeos ayuejsuoo oun 
so “co ‘y ayens ey nod omvyeos ayuR}suOd uN yso “° no 


fy 


(s) MH +H + M4 My op = My 


soide.p “x ap uonendod ap moyea ey] suostnsuos 


snou ‘9 oddvid ve] 39 Y gens ey suep / sun] mod 
‘yuourgstooid snjg “« | uonendog » suojadde | snon ‘oddeis 
PR] 10 ACNS ek] UOTOS DIBIP { op uOTNG stp ve] a]Jonbey] suep 
uonendod sun suojsuss snou ‘UorTye[NUWIs 900 sueq 


uv]d np sazueunA0d sanbysi.19}9v.189 sap a3du09 
Ud ISLId-UOU BI Op UOHeYSH]] : YuonRMUIS ["¢ 


‘asqye.ys onbeyo mod saguuop ap syqurasusa onbeyo suep 
yuoumepusdspul soem suoneindut ¢= Wy suosiyyn snou 
‘uu ‘suoneyndunt soy mod ose owerxip onbeys suosiyn 
snou sind ‘oaneurxoidde soussioauo0d ey Iuaj}qo mod 
asepol op spotied oun Juepusd mMouUOT[HURYOS | SUOINDaXO 
SNON “(0661 WS 39 puRJ]9H) sqqin sp Iouuoj]HueYyo? 
un juesIyQn uo sonoueied sop smopeA soy suoIN snou 
WH olsajyens el og ‘sonowered soy sno} mod sosnyzip 
UOLd & SIO] Sap SUOSTTN SNON ‘| Neafqe} nev saguuOp SIO] sap 
Insed e sayuenbueul soguUOp sop smMo[vA So] SUOUUOT}D9I9S 
SnoU “USUTOWSTXNEq] ‘Sd[IpOuUl So_ SUBP sasNpoUI jUOS 
mb “(y ‘7 ‘x ‘x ‘Z) ‘sagarasqo saguUop sop soyuesodu0s 
so] jueyoes wowasode sioj sop imied e uonendut.p 
So[9pOul sop sonoureled soy suOUUOT}DI{9S snou ‘USUI 
-oIgtwWdig ‘sootidoidde wotsjsod e soanorpoid souusisaXeq 
SIO] So] soide.p soom JOS suonendu soy soynoy 


(2 ON ~ “40 ‘(Fo “Ho + PAY + MO) N WH 
(40 Heo 4 Hy Hd + 40g) ay XA 
(0 Pty 1g + Dv SVa 


——____—__,—___— 


ajuenbueur “4; mod uoyeyndut,p sjapoy ayonbngq 


uonendull .p soisayeN¢g 
[ neo[qe 


uoljeyndul,| suep esHeuuogy|UeYoE,p Ue|d Np uOHesI|apow e| ap soUeYOdWI,7 : AeuUly Jo UeUJEUNYHeY ‘Ve}IEy Ol 


onsojeyeo ne GqX-100-ZI WN ‘epeurD enbysneis 


“sIeIg UN jeIJOSNed 49 SI]IQvsOUsI | 
JIVIOJOIA Y & JoUUOTIPUOD sed ou ‘soyUeNbuURUT ssd9UUOp sop 
UOHeIIO op SUUSTURIOU Np oIJed yey sjqvieA 33390 onb sored 
‘VY INS UOISSOIBOI BT JUSLIOdWUIOD saIsgyVNs SION say ‘oyeNs 
onbeys ve yuowssedas sqysnfe JUOS sofopoul soy] ‘WH 1° XA 
Inog ‘je[durod ssguuop sp s[quiasud | eB asnfe so o[apow uN 
‘Svq Inog ‘soddvss ud ost PI JO UOTJVOTFHeIS ev] SogIdOIUI 
yuos sjonbsoy suep somoyegye sjoyjo eB XxNeUWIOU sofapoul 
Sop JOSI]IN & d}SISUOD ‘PIF{ B9}OUSP ‘OIdOeNS OWIIISION eT 
‘978.8 ve] suep oddeis onbeys mod soxy syayjo.,p uonesTyn | 
e a0vls soddeis ud stu eI 30 UONKOTHeNS vl oIsQUI ‘KA 
agjousp ‘oularxnep ey] ‘aseuUOT[HURYS.p ued np ajduI09 
Jud} op juouolonua jyoulo ‘Syq sojousp ‘olonuoid ey 
"| Neg]qe} Ne SddUUINSEI JOS SoIsa}eV.NS sag ‘asepuos op urd 
9] INS UONLULIOJUT,] Ip SUOTISTTIIN soyUdIOTJIp ns yueAndde -s 
wk op uoneyndut.p soisoyeys sion suoumumexd snoN 
‘Q[QeIOUSI IOS soJUeNbuUPUT SaguUOp sop 
UONeIIO op SUUSTUBO a] onb ue oseUuUOTTHUeYDE .p ULTd Np 
SOJUIV.UOD Sd] SITNPOUI Nv} [I ‘sjoor saguUOp op sayquasus 
xnoIquUIOU op suep sed of JSd BOO oWUOD “UonbueU 
sopuuop sop onb yey ne oIoI jso dsdeUUOT]HURYDE.p 
urd oy Is JuaWaToIMeN ‘oseuUOTMURYS9,p urd np 
sed puodap ou ayqeioust soyuenbuewl saguuop ap uones10 op 
OUISTURSSU 9] IS OUOU ‘asepUOS op Ud Np a}duI09 ITUD} sed 
OU Op We} ne np aye ynod steiq oy aonb JansnyI.p ue ‘adders 
eR] &@ no gens ev] e doUeUdyIedde | op apuedap saouuop 
ap souasqe.| onb sed suoyjouriod ou snou 4uaus1oqiiad 
‘YY & SOTJOUUOTJIPUOD JUdIOS saguUUOP sod Imod suonendut 
so] onb uonipuos e soyuenbuew sosuuop sep uoTedID ap 
USTULIOU 9] JoJOUSI suUOANOd snoN ‘(9/6 Ulgny) presey 
ne onbuew “x onb onbiydut ,uonenbs,7 ‘uonsonb ua 
q1un | nod onbueur x op moyea ey onb oyrusis t= Py ‘toy 


("X10 — Lrg ‘0-)dxe +1) 
CX 10 - Ly8‘0-)dxe 

: TJNOUINg op To] ouNp Ited e 9911} SO 

Y ‘omeulqg asuodsl ap afqevuea vy ‘oyun onbeyo mog 
“SOQUUOTMULYDO SoU sap % YE UOIAUS 
mod juonbuew sasuuop sap ‘x mod ‘aonb jo a9AJasqo yuu 

-o191JUd 389 Y onb suosod snou ‘uoy{HURYoS onbeys mog 
“SUONLINUIIS SOT Syn} SUep soynduuI-1y;nU saguUOp op 
SO[QUIDSUD S23] SNO} Mod sasi{yN JOS SMd}VUIYSd Sad “JOJART, 
ap dues us yuotUaddojoAsp Jed uoNestIvoul] op sonbruysay 
SOP UOJOS S9URLIBA SO] JUDLISD soUTNOI sad “y Jorlorsoid 
np (Ppooc Aoyumy) « AdAINS » souNNoI soy yuesTyN 
ud sgfnoyed yuos mb ‘sjonyiqey osepuos op urd os] ms 
SOpUO} sIeIq suvs JUOUTOAT}eUNTXOIdde smMoyeUIsd soy JUOS 
¥ MS X Op UOISSdIS9I LI SULP S]UDIOYJOOS sop siMo9jeuUNsa 
soxq ‘oy oddeis el suep Xx op uolyHueyoa.p soueLtea 
eT isa “Js yo “A op uoT[AURYOY,p souRLIeA eI sd “8 No 


(r) (I= “y)id 


« Loy 


e9lL 


-000 001 
ee yf 


pe OG i I 
‘y | (Se) 200C a 


\so b ap soueleA kv] op soja[dtuiod saguuop Ud IN9}eUINSd J 
‘oy oddei3 e] Suep suITyso [e}0} a] so “MAMA = “4 no 


{ns gc ad 000001, 
O0Ga I 

‘Tanjiqey osepuos op urd 9] Ans 
QpUO} STeIq SUBS INa}VUISd,| 189 { Sp Soajo[dWIo0d soguUOp 
ud IMoyeUINsaJ “VY IMs { ap uorssaiSai ey op uoNe|ndod ap 
SJUSIOJJI09 saj yo “X op uoNeindod op suussow ve] “{ =O 

JUOS soUjsd sonoueied soy ‘uoneindod onbeys sueq 
‘t= 47 sayjonbsoy nod soyun yo¢ Zz suousigo 
snou ‘ouoq ‘sauuo][HueYd9 oddeis onbeyo suep sgytun (~7 Op 
a{duis onoyegye UOT[WURYOS UN suOIN snou ‘sIng ‘oWOyTUN 
aseuuo][nueyos,| e@ yUoWOAyeIedwi0d urd ap sjayo soy 
IISsOIs Op UTE dV.S BT UOTAS JUSTIA SaddvJs Ud suOT[WURYDE 
Sop Soy]Ie) say “s aens ey] op mused e soddeis c= ‘u jo 
p ayes ej op med e O[ = "u ‘E ayeNs ev] op med e soddes3 
O¢ = ‘u ‘7 ayens e] op med e soddeis 07 = U‘] aes P| 
ap amied ev soddeis gp = 'u op ojduris amojegye uoyyueYyoS 
un suoI snou “INdUDUWOD Nog ‘soidop sInoIsnyd eB soddeis 
ud oseuUOT[URYsS .p ued UN yuURsITQN Ud UONeNdod onbeys 

op ised ve soyun so] JUOWMOTIOJegTe SUOUUOT[HURYDS SNON, 
‘JUDATNS IND sUOT|OIS XNB SUOILIOEP 9] SNOU SUTUOS 
‘uoyeindod onbeys nod sapoy}eur soyua1ayjIp suOsTTN snou 
‘K Joiguas mod “(01 0)N ~ “ty ap muaed e ‘oy oddeid 
R] 19 aeNs ek] suep oyun oun onbipur fsorpury no ‘4! y 
anbeys suoisuss snou ‘ayiordurts op ronos sed ‘suonendod 
sIOn soy sueq “{ 10 XY ‘ajonbusa.p sayqelieA xnap 94sTxo 
[I ‘agro uoneindod onbeys mog ‘saisap sinorsnyd ev saddess 
ud suoT]HuRYyoS p osei np sso] ued np sjoyjo soy Issoss 
op uye oddeis op soyjre} soy JoLIeA suosiey snoN “QS = “NV 
yuo soddeis sjuenbuio yo ‘sz =" yuo saddeis Qo 
‘OOT=""N yo soddeiso9 ‘ooT= "“N yo soddeis 07 
‘oog = “!N yO soddeis Q] ‘ovens onbeyo sueq ‘sain “Ay 
pusiduios y aes ve] suep 2 oddeis onbeyD “Ss ‘*** ‘T=y 
Inod ‘soddeis ogz7="4N ounoeyo jueuoiduIod ayes9 

JIIe1 Op sojyeys buls ua sasIAIp ysd uoyendod onbeyD 
“SUOTIIPUOD Sone p B d[GesITeIOUNS 
yuoWoTessao9gu sed 4Sd,U SoylOvoIJJOUl/steIq sop ImopueIs 
eT ‘yuonbgsuos Jed ‘asepuos op urd np uonesispouw 
R] op souryodumt.| JosnyI.p uye sogsijAjs yUOS sogjnumts 
suonemndod say ‘sayuounsiod uou urd np sayqelieA op 
UOISNIOUI | Op 1OJJo,] JouTWIexs nod ‘suonejndod susrsto.y 
JO OUIITXNap soy 39 ‘soyUoUTIOd ued np sajqeLIeA say soyno} 
amour .p syodunt {t.nb sanuousp mod uonendod sismusid 
RB] SUOSITQN snON ‘oddess sp simoyeorpul xne IU ayes op 
SIMOJVOIPUI XNv TU IJO14S9,U_{ ‘UoNendod swiIsioy ev] sueq 


900Z aiqwasep ‘a}enbus,p senbiuyoe | 


‘addeis op sjojjo sop uoU steul ‘oes op sjayjo sop puodgp 
X ‘onendod surarxnop ey sueq ‘oddeis ap jo ayes op sjaqyo 
sop sloy ey e puodap x ‘uonerndod osonueid ey] sued ‘sajeys 
so] Suep soddeis uo sasitu jo sooyneys juos mb ‘soqrun 
000 OOL= N 2p sazqio suonendod sion suopnutis snon 
uoleindul.p sajepour say suep ued np sonbystigjoeres 
SOP UONLISOUT.| B SOIOOSSe SOLLOKOTJJOUT/STeIQ Soy JONSN]I 
Inod suone[NUs sap suOsTHN snou “UoTes ayuasaid eV 


SOAHCAISN]][E SUOTFBINUTS = °¢ 


(6661) UIgny Jo preueg onb Isure “(966 ) YOIAOOSTS 
jo ueyjeunysey “(Q1661) WqnY Jo SU ‘TT “(P1661) 
ulgny 30 ueyjeUNYyseYy ‘tT slidwoo A ‘smojyne simorsnid 
Jed sgsodoid 939 JO sofeyUsUTepUOy UOSTeUIqUIOD op 
S9]SOI Sd op syUsWIOUUONOJIOd saq ° al (% | Dye ce AD 
so G mod % (0—]) ke dDURTJUOD Op aTTeAJOUT UN Nb dyOs 
ap ““n/ "gq W+) =" no ‘oyoqy ap sossop (/4 +1) 
(I-W)= “a dae 7 SIO] Sop IMs sogpuojy ane jUoAnod 
SOOUDIIJUI SOT ‘Py Op IO1OPOUr IMNOTeA oUN Mog ° OAC: /)zZ 
4b sa G mod %(0-]) & dOURTFUOO op ay]eAIO}UI 
un nb o110$ ap ‘sayeuJOU SIO] Sop Ins sagpuoy a9 yUOANOd 
© omeyeos a] nod saousigyul so] ‘spuvsd yUOS PY 10 U pueNd 
‘“b op oouenea ey Jounso mod “n+ %q(4+p)= "7 
32 © Jounso mod “A sasipyn sioje ynod oysAyeur /T 


Teh 

(¢) Th henge RG Me 
IN 
ay 

(Z) (I- wy (Bb - 5) <= "4 
IN 
=)/ 

(1) Tae Reale 
IN 


> SQOUDSIOFUT 
So] Inod samessao9u yuos jyusAIns mb sgynuenb soy 
uowlgstogid snfg ( 1 (2 Sef JueUIquIOD Ua GH arTe[eOS 
3] Inod sopljeA saousIOJUT soy IUd}qQo nod aysAyeuR | “(L861 
uIgnY) SUBP soyoap saseyjodAy soy snog *,q@ seguUOp 
op sJquiasud | suep 7 ap 30 b ap smoayea soy GuoWOANSedsal 
“UOS Dae @y? anbysSuOsod., Vern =, dNOd 
"sqjgtduro9 saguuop JNs smoyeUIss 
sop yuos n yo b onb omp-e-js0,9 J [eulsuo oseuUOC] 
-[nueyos p ued o] Ins yURpUoJ os UD ({‘7) Sp oNO}EgTe 
uo] HURYOS UN .p soidne sar][lonse1 SOQUUOp Op SULIOF 4Tey US 
e}9 (,q onbeyo ts swiuw09 Juessise uo n Jo b aytoods [I.nb 
suosoddns snoy “7 mayeurjss un ,p ussouw ne ‘h ap souerLeA 
BT Jo *b Moyeuryss un .p uskoul ne CG suse oysAyeue | “7 
 ‘ginduit saguuop sp sfquiesua onbeyo sueq ‘uonejndod op 
 UOISSOIS9I Op JUSIOYJI09 uN no uoHRINdod sp suuskow oun 
ong weLmod 6 ‘ajdutoxo reg “(4 ‘Z)O =O enouesed un.p 
joins ne soousIgJUI sop ole} ]NOA sagUUOP sap moyesTyN 
un ‘sgyndun-nynur sosuuop ep sayquiesua sao seide.q 


(1) 


onsoyeieo ne GdX-100-ZI .N ‘epeueg onbysneis 


¢ SIU ¢Sqo_ ¢ 


(WT yd AZ) = 
‘sjojduioo «= sogquUOp 9p = sajquiasud py smuaygo mod 
sIoy PF‘ T=] JUowurepusdspur sajyado1 yUOS sasei soy 
(aT OA EZ/"X) OP UOL\sod eB oanorpoid ouuarsexeq 
IO] ®] Op uoryeurxoidde oun.p med e sasem sop soide.p 
soHNSUOD yUoUOTToNyIqey JUOS ““X op sIMoeA soy] 
‘OSEPUOS ap Saseq Sd] NO JUdUUASUDIOI 
np sIoIssop soy soide.p ojdwioxe sed ‘quoweaneurxoidde 
sulow ne onuuos jso ued oJ IMs UONnRUNIOFUI,p oud 
90 onb suosoddns snoy ‘ay]Ie} op sommsour sap no soddeis ap 
NO soyeys op smMayeoipul sop ‘oaydwioxa sed ‘uonejndod ey] op 
soquiun Ay Sot Inod px AV suOIsUSLUIp op uRyd np sofqeLeA op 
SOLNeU BI 7 WOS ‘asuodal-uOU ke] ap asneo ev onbuew Inb °"x 
op uorpiod ey yso “YY Jo ‘agArasqgo yso Inb “x ap uoniod 
By iso “x ‘t= ‘7 sayjanbsoy mod soyun soy nod dxu 
SUOISUDWUIp op ajonbua.p sosuUOp op soLneur ey (Oy Z) 
= "XK WOS ‘uoyendod ey op saytun say soynoy mod dx NV 
SUOISUSUIP op ajgnbus.p soguUOp op SOLNQeU BI X HOS 
‘9sodxo o.NOU Sp SUT xnv oITessao9U sed js9 U UORneoTTdWIOS 
Op o1Udd 99 sTeUr ‘OOUeATITNU oT[oKIJed asuodss-uoU vy Joye. 
op ulfe onpuaja ane jnod uonejou eT “(“y “* S'y)=y MOS 
quouonne “~ = “y 19 ‘ajeuIStIO a\gnbus,; e puodes /aytun | 
[So [= f Y wos ‘asuodss-uou ey e ayalns jsa ajonbus,| 
op IqeUeA sfnoes oun nb suosoddns ‘uonejou ev] Joydurts 
Mog ‘oxojdwos oseuuoyMueyse.p uejd un,p uosow ne 
anus}qo uoTHuLYoS,p aie} eB] u Wog (“7 “'7) =] HOS 
NOT T=L no quowanne 9 = ‘7 19 “opeuIs0 agnbus | 
suep e9uuoNogi9s 3s9 (oyun J Is T= “7 os ‘Ar aTTIe} op ory 
uoneindod sun mog (/86[) Ulqny sp UoNROU Fe sUOSTTN 
snou ‘sioTUJap soo soide.p saous1gyUl soy yo soynduwi-nynu 
SOQUUOP Sp SoTQUIDSUS Pp UOHONSUOD ve] SILOS op UIFY 


sgynduil-n[nul ssguuOp 
dp Sayqulasud sap saide.p sadudIgJUT °Z 


‘d]JoNUNNbes UOTssoId9I Op apoy}sw oun 
uojas AdAING UOTeUIWUeXY UONLINN pue yyeox{ [euoneN 
Pe] op seo oy suep soyuenbueul soguUOp sop jueyndu US 
ued np sonbrysiiajoevseo sop uoneisajqut.p oysoidde osomuaid 
RB] SUONUOUISP SNON “o]qQISneJd Hos (9/6] Ulqny) Presey 
ne juonbuewr sosuuop soy ajjonbey uoyas ssoyjodAy,, onb 
mod sastnbor soaneordxe sayqvirea soy yUoN[OUI sofapour 
soq onb uonipuos e ‘soyuIeQUOD sUTUOD sooisoyuI sed 
JUOS dU sonbystgjoeIeD op oiUdS 90 sjanbsay] suep sojopour 
sop solide p soyiey soyjoo e yUOWOANeIedUUOD ‘sojUspnid stew 
‘SOOBOHJOUI SOOUSIOJUI Sop & NI] JouUOp ynod ajonbua | ap 
so]qelivA xne sogijai sed yuos ou nb urd np sonbysigjovses 
sop oimpoynuinb yey of Issne yuoNsn]! so[q ‘sieiq 
9] oIINpar ynod uOdSey 93399 ap osepuos op uid np a}dw09 
Jmu9} onb JUsayUOW SUOTILINUIIS Sa] “SOXTJ S}oJJo Sop JUSTIN 
Ud SOISOIUT JOS UONLOYYEIS L] OP S}OJfo So] (II Jo somMoyegye 
sjayjo sop juesiyyn ua soidoyur yuos soddesis uo osm 
P] Op s}ayjo soy (1 no sonbrysresoty solgpour sop ins omdde:s 


| uoneyndwi,| suep ebeuuo}|iWUeYyoS,p Ue|d Np UOHes|}epow e] ap soUeYOdUUI.7 : AsuUly Je UeUJEUNYBeY ‘aIEy ZOL 


"SIU)-SI¥IT “OOT 8h IN “loqry uUy ‘URsIyoIP] JO AjISIOATUL) ‘YOIRasaY [BI90G JO} sINIHSUT pue sonsNnesorg Jo juow eds ‘uLYeUNYSeY “q OO[JOALL, 
‘stuA-si¥1q ‘QOLLZ ON “Weying ‘AyIsIATUA, DYN ‘1SZ06 XO ‘seoudI9g UOISIONG PUR SOT}sHRIS JO oINNsU] ‘AoUUTY “Yi Iepeyeg 39 JoNOY “q oWIOIOF “| 


‘aioruoid ey onb sonbryduros snyd snoyes sop yombeor mb 
‘QUIdTXNOp BT ‘UOHR NUIT .p sayapout soy suep soddess op no 
DLS Op sjojjo so] Inod soyeummou sayqeliea sop pussdui0s 
‘QIAND Ud DOU vB JpIOKJ JWUOWOANLIOI Jso Ib ‘oronuoId 
eV] ‘uoyRndui.p sojapour soy suep urd np sonbnsi 
-oeIed sop ajduiod mua} op ona ud sojduts soyooidde 
xnop suosodoid snou ‘naly owarxnep uq ‘sojuenbuew 
sosuuop op sasapour ayjuenb oun nb yuejuasoid ou ofdyynu 
uonenduil | e SILUNOS SagUUOP op So[quasUa sop ev dd¥"pUOS 
op urjd a] ms sopuoy simoayeumsa sop onbijdde uo] Is 
ourour ‘JuRyIOdUIT a9 nod steiq a] onb yuonbiput suonepnuits 
so] ‘soddeis ud stu jo sans ‘soisop xnop ke suo] WURYOS 
sop suep odnynur uoneyndun oun suopnuris snou ‘els Mog 
uone Indu .p sa[apoul so] suep oxojduios asepuos op urd 
np sonbystg}oe1ed sap o}dwWi09 19} op yUS}OWO sunoyndut 
so] onbsioy ommpoisd os ynod mb sietq oy suoNsn snou 
nal] Jomueid uy ‘a[qnop jso ajonse yuasoid np ydalqQo ,T 
"JUOUUIIVI He} as ejIO ‘Ueyd 
np sonbryst9gjoes1ed So] JOIST ,p UlZe SddTJIPOUT 3.99 JUSSsInd 
sopoyjeul soo onb uatg “([Q0Z JesJoquaos 39 YAMOOH UPA 
‘TysmoydeyT  ‘ueyyeunysey)  ayjayuonbes uolssalsal 
op sojapour ap no ‘(sayeyog s0¢ sed 9sIpPsI WYON 
JO1OIso] 9] ‘oyduuoxe sed) soneanTNu xnei9Ues UOTeST[eOO] 
ap sojepour sp no xneUWIOU sayapour op joOynd JWdAJOS 
QS ST] Uone duit p so[spoul sop oimM.ysuod mod sayqruodsip 
sjororsoid soy yuastyn sj nbsioy ‘soddeis ua osm ex 30 
UOnROYHeIS ek] OUIUUOS ‘soxoydurod aseuUOTTHULYDE,.p sud 


‘sojonbus ‘asuodas-uou ‘aydnynur uoneyndur ‘axojdwios asepuos op uel g 


sop sonbysiigjovies sap ajdwi0d JusWIoFeI yUoUUIDT] sIMNoyndut 
so] ‘stofanoL “(L86, Ulqny) sseuUOTTHULYDE,p ued ne 
d]JOUUONIPUOS oNpUdL Sd dIBTUJOp 9300 ‘oydnynur Uonendut 
aun Igns jueke saguUOp op sa[quiasud sop soide.p soual 
-9JUL.P Sepoyisul op jUSUTAssT[qeI9,| 9p SIO] ‘sLIOpY} UY 
(6661) 
Sud] 30 preuseg onb tsure ‘(966]) Ulqny AoA ‘suoneordde 
soqne.p onacr oun Mod (SOOT “HOOT “ED0Z HUSA -€00T7 
UIgnY 30 JoyOY “‘URYJeUNYseY “E661 MINT ‘C661 UIqny) 
UOISNIp spuvsis B SO9UUOP op SIOIYOY soy suep sjouuosiod 
SJUDUIDUSIOSUdI Sap UOTOO}0Id eI Jomsse mod sasodoid 939 
yuowsyeso ev odnynur uonendut,T (SQOT USYOD 10 SuvyZ 
‘nye, ‘NiyD “ueyjeunysey “Ioyuoyos) AdAINS MOIAIOUT 
UyeoH [PuoneN YI 30 (Q66T [JOYOUS y) soouvuly Journsuod 
jo Aoamng ye (661 UWIgny Jo op ‘oreypy “uosuyos 
‘sory-nezzq « “‘Joyeyos) =AdAIng uolyeuNUeXxq uUOnLyNN 
pue yyeoH yeuoneN ey “(661 UNeg 30 URYjeUNYseY) 
ABAING somppusdxy Jounsuod vy (166) WT 30 UehIopH) 
waysKkS Suoday siskjeuy Ayyejey of suep ‘ayduroxa 
qed ‘oasiynn 939 & ATA “(L861 Ulqny) soyuenbuew sosuuop 
sop ojdnynur uonendur,| iso asuodal-uou ap o1ued 99 Joye 
Inod syooidde sup ‘suoysonb soureyioo e.nb yuopuodal 
ou sone.p 39 no} np sed yuopuodal AU souTeyaD ‘aleU 
-uoysonb ne yuawia}9[du09 sayno} sed yuapuoda ou saguUO] 
-[UeYE soyIUN soy ‘sojgnbus sopueis soy suep ‘[e1ouNs U_ 


uononpo.uUy *“T 


: S99 SJO 


‘sopdnynur suoneyndunt 


sap Jag10 Inod piepur}s sjatoisoid sureyioo yURSI[QN Ud dIATNS 3.9 nod Inb oxa;duloo asepuos op uryd un,p sonbystsjowred 
sop uonRIsaiul,.p ojdums oyooidde oun.,p uoneNsuoWwep oun suoUUOp snoU ‘saT[Ie1 sogUUOp op opIe., Y ‘uonendut.p 
sg]apoul sap uoNeoyIoeds eI suep o8epuos op ued np sajqeieA sa] oiNpour eB aysIsu0D Japgooid ap sms snd 2] uaXour 
3] : Smnoyndunt sop uoNUSzUT | e IMs nb uoNdiOsaid ef JoyNUTJOJ e yUoWOd syeINSEI sa_d ‘soqUoUTVIOd soAneo dx solqeueA 
Sap Issne JUSUUSTUOS saTapour say onb UONIPUOS & ‘SOLNPAIOSUOD SdOUDIOJUI Sop B Noi] JoUUOp ynod uOHRIndull.p sajepoul 
Sd] SUeP soyUTeNUOD oUMUOD URTd Np sajuoUTINd UOU sonbHsLIg}eIeD Op UOHONpoQUI.| onb Issne yUaNUOW sUOTeTNUIIS 
SoJ ‘uoNenduit.p sajapour soj suep ueyd np sonbystgoesed sap 39JJ9,] 9p aJdu09 JuLUD} Ud jINpeI aE nod steIq gy (1 onb jo 
JQIOIUT.P SOTGULIVA xne sagI[oJ JUOS ULI Np sonbyst19}9eIed Soy Is JURLOdUT a9 nod sreIq 9] (I onb suonenuts sp uskow ne 
suO.QUOUT snou ‘ayorIe yudsoid a] sued ‘asepuOs op ux Np ona op juIOd np sagsteIq suONeUINSe sop armMpold ynod aydyinut 
uonendut oun e uodse] d1[9} Op sTuINOS saguUOp ap so[quIasua.p asdyeue., onb ypord oL09Ny} eT “IQ ‘suoTRnduT sing] 
suep ‘soddeid ud ost Pe] 19 UONROT Hes vy SUMO ‘soxajduos sseuUOT]HURYD9.p sue{d sop sonbystajoesed sop a}dwio09 319} 
sed ou e soyod yuos suatoneid xnoiquiou op ‘ayduns onojyegye oseuUOTTHUeYSE UN,p dsoyjOdAyY | Ins JUasodal aapoul uN Ins 
sepuoy afdnynu uonendut,| mod sasiyn prepur}ys sjororsoid sop yednyd ey] surwios “uepuadag ‘aseuuo]]HUReYOS,p ueyd np 
JUSUWUITJOUUOTJIPUODS 91e} JOS UONEINduT,| onb astxo soyueNbueu soguUOPp soy J9}1e.y nod ajdyynuwu uOHendurl | op sI09} eT 


puinsoy 
_ AouUry “yf AvpAVYIVS Jo ULYJVUNY Sey “y IAO[JOALL], “APIY “qd OWOAOL 


sojuvnbuew soguuop soy, anod ojdyjnw uonendut | 
suBp dsvUUOT[HULYdI,.p uv]d Np UOHLSTIpoOU ET Op sdUvIA0dWII, TJ 


LOL 


anbojeyeo ne GdX-L00-ZI .N ‘epeued anbysije}s 
891L-LOL “dd ‘Z .N ‘ZE 1OA 
900Z euquwasdep ‘ajeanbue,p sanbiuyoo | 


"YIOK MON “asuudg surdwpg daaing 
paisissy JapoW (7661) “f “URUMEIM 19 “G “UOssuaME “q-"D ‘TepurRs 
LCS ik Ge 
‘QL ‘pylajawmolg “[e\01 uoNelndod oyuy ev JO JOJUTSS UOISsoIsOI 
[erouss oy} JO sOURLIeA oY) SUNeWIsO Joy onbruyoo) yenpisor 
Porysiom OL “(G6861) ‘ff Weunjosp, 10 “g “‘UOssUME “q-"D ‘[epurEs 
“LTE-SOE “ST ‘SOMSHDIS 
pang fo pouanor ‘asuodsatuou jo yUOWyRON 9Y} JOJ poujoUr 
prepurjs eB se uonPIqie) (6661) “A-D ‘Tepules yo “S “Wonspuny 
“LSI-6£1 ‘ps ‘anbysynjg ap ajpuoypusajuy anaay “Suedu JO 
SOJLUT}S9 JOY sjuouNsn{pe ssuodsozuou AdaInS (9861) Very WT 


@JNUSBANOD Bp SiNewua Sap }@ BSUOdsaJ-UOU e| BP UO!I}OEU09 e| INOd aGejeo sed uolesepuod e| ap UOH}esIINA : HOY 


ansojeyewo nv Gq@X-[00-TI N “epeueg onbysneis 


"67-87 ‘OE ‘alanbua p sanhiuyoay ‘oreyUoUTWIOD ‘(4p007Z) ‘S'd ‘HOM 
"ELE 
-€97 ‘8p ‘aouasafuy puo suluUD]g [PISS fo joudnor ‘Surjdures 
ADAINS pPoseg-[apoul poysisse-uoneziwopuey (ePOO0Z) ‘Sd ‘HOY 
'969-£69 “68 ‘UONIDIIOSSP JBIISIDIG UBILAULP ay) fO PouAnor 
‘sAOAINS Ul asuodsoJUOU SuT[puey UO 9]0U VY ‘(P66I) ‘Sd ‘HOY 


‘Q67-LET “PT ‘a2uasafuy 
pup suluurjg jooysyojg fo jJoudnor ‘souelIeA [euoTIpUOS 
S}I PUL JOJCWUNSS UOISSISII JUDISISUOD USISOP WL, (0661) “S'd ‘NOY 


O9/ 


andoyejeo ne FqX-[00-ZI oN ‘epeueD onbnsneisg 


UOTIRIOOSSY [RONSRIS UROLIOUTY ‘UOIIag Spoyjayy YIADASIY 
daaung ay) fo séuipaaz04g ‘Ayyigeqoid osuodse1 poyeuyso 
Suisn Juowysn{[pe Sunysiom osuodsamuou won” (pOO7) Wf Why 


68-6L ‘0¢ ‘aignbua p 
sanhiuyr], “88-86, Aeaing uoyndumsuog pooy spimuoney 
ey & uoNeordde yo ssuodas-uou op UOTeNyIs Ud UOISsoIsEI op sprlod 
ap uononpold “(h661) ‘C'H “xe 19 WW “UYysnoT “yA “Joy 
“$7-S ‘97 ‘ajanbua p sanbiuysa I, ‘ase uuo[[HuRYDE | 
e oonbydde uotssoor sed uoneumsq (7007) WM “end 


“C09 
-26¢ ‘UOTIBIOOSsY [eOTsHeIS UROLIOUTY ‘spoyjayy yowwasay Aeaangy 
uo UOljIaG ay) fo ssuIpaaI0/g “WoHedyHeys\sod pue ‘esuodsosuou 
‘sonyeA oWoXe JOF UOTeIQITeO yYsIomM Suljdures Joy jopow 
enuouodxe peziyesjoues sy, (Q00Z) ‘O'V ‘YsuUIS 10 “Ay “Wosfoy 
‘Jpd'yoy sJoyoy/sioded¢g/aos wsoy mmm//:dyyy ‘souartayuod 
yorresoy + ASofOpouJOPY =eonsHRIG UO soyMUWOD [elopoy 
€O00T B USsoIg ‘aINNOUBY Jo snsusg ZOOT oy Joy AsojeNs 
yuousnipe odeIoA09 & SuldojaAoq “(€00Z) ‘S'd “HOM 1° “PW “Toney 


66E-6LE ‘OI ‘sousHDIg jpIAYYIOC fo JoUANor “LOTRIGTTed 0} 
yoroidde wuoy yeuorouny VY (Q00Z) “A-"D ‘Tepuses 10 “WA “ovAgsq 
‘78E-9LE “L8 
‘UOIDIIOSSP JBIUSYDIG U_IJaULp ay) fo joUAnor “‘Surtdures AsAIns 
UI SIoyeUsS vONRIqTe (7661) “AO ‘Tepures 19 “O-f “oy[tAod 
LOLL OE 
‘gjanbua p sanbiuyrzay, ‘ajagnbua.p saguuop sap mod uonesiesuly 
Jed soueiea op smoyewnsy (pO0Z) WNT Ory 1 “V ‘Heuuoq 
“bbbr-LTb “11 ‘SousUIIg jpoUDUAaYINYy Jo S]oUUp “UMOUX 
ore ]e}0} [eUIsIeU poyoodxo oy} UdYM s[qGe} AoUsnboy ojdures ev Jo 
yuousni{pe sorenbs seg] & UC ‘(OP61) ‘AA ‘Ueydas yo “A y “Suruaq 
UONRIDOSSY [ROT}SIILIS 
ueoLiouny ‘uo1jsag spoyjapy Yyospasay Aaaing ay] fo SBUuIpaaz04q 
‘gsuodsozuou odie] yy AdAIns oMUOU0Da Ue JOJ soWayos 
uonRIgies sAneuloye uoneneaq (P00Z) ‘S'd ‘HOY 1° “OD ‘asnoip 


noe 
“6bE “TI ‘SoUSHDS [PLOYYO Jo joudnor ‘Keamng OdIeQOL, BTUIOFTED 
oy} Ul Suryel pue Suljapour ssuodsozuou eIA asuodsoruoU 
wun SuNsOD (9661) ‘df ‘Id 1 M'S ‘HY “OD Auog 


ary deisonqrg 


{JUSUIdIQUIOUSpP-snos np no asuodas-uoU ke] op 
InayotIpoid May[low un Jed asvyeo op jo SoTqeLIeA op 3n9}00A 
np sojuesodwios soureyao op yuowdorjduior np joqJO,] 
pelos [and Zo[qrey snjd ouusAour onbyespenb mois oun red 
d][O-}eIMNpe 9s Njosqe sTeIq Np UOTONpel eR] JURdYDE sed 9] 
‘Jo ofqiey snyd sterq un [I-yresnpoud (-) f° mod yuorgyyip x1oyo 
uy gonbnead ua (.)f op xioyo ne T° “7 ap aypqisues 
eB] Sd oyJonb : soyueAINs suoysonb soy sIpMms SSYN 9] 
“so, qruodstp JUSUIDT TORT 
suonnjos soagne,p onb jyuowuonbey snd sjqeidaooer 
ayoyomnoy oun suep juonjzis os nb spiod sap osmnpoid 
d[quios jo Jonbrdde e aydumts yso (97) Uonenbs J ‘aanorpeid 
UONRSI[SPOUL VI INS I9pUoJ 31e}9 9}X9JU0D 990 sUepP SUISTU 
e310] Jed oyoJjo ose[eo np osyeuIsuIo uONRoysnl e7 


6S/L 


‘onbnead us owafqoid op sed asned ou Bag ‘9 no 
T singjea xne sIoy xnop sqeALisp sed jso,u (QZ) UoNnenbs J 
ap ()/ ‘(6[) Uonenbs,| ap aseyeo sed yuowrajsnle | e yUOW 
-omenuoy “Q=(),f‘7 no Q=()f puenb ‘onb suojon 
‘sptod sop juourgjsnfe |, op souvyoduit | Jojonuos mod ‘7A 
30 J ‘saljqeuisoid smayea sop e& aieoul] adeyeo of onbuo.y mb 


‘a<ox Is 7 
(02) ASP XST Is O'xr = (O'X)/ 

T>o%xX IS 7 

: MUO} BT 9p 3so (-) f ‘ayooidde 2309 sueq “(p00Z 

YOY 19 snolD MOA) sojqeiy snd sayonbua.p xndo eB xnv}0} 
So] Jopioouo0d omey e uOodey op ‘oJURyOdUT ssuodoJ-uOU 
ddAR DJOOLISe oMUOU0DS | Ins ajonbud ouUN,p UONddLI09 
RT od 39 (€QOZT NOY 19 Jone MOA) ZOOT Sp oAMNOLISe | 
op JWoWdsUd.dy Ne JUdWIdIQUIOUSP-snos 9] Joye Imod 
(P661) [JOO 38 JOT[N op oyooidde | op soyuelea sop osiyyn 
® (SSVN) S9IAJog sonsneg [emyNoUsy yeuOneN 9] 


SSVN 29] 90AB XNBABIL, §f°6 


UOISEDNO SNe oUN ke d9}10d91 

oo WOp sEpI ay990 ap sipuosoidde snjd asdkyeue ou, 
“9SUdN9I JIOS sJURPUOda op UOT][UYDI-SNoOs 9] 
onb saide sajqruodsip sayuesodwios sayqeiiea soy yuouonbrun 
yiespuciduios yo *x* Sy yo ‘x4 oMua soUdIOIIp 
eR] mod oasiu09 ‘asuodel-uou vi] Mod oasrieo of ‘aseyd 
MWUIIXNep ev] ‘ssvUUOTTHURYOS,| op JUOWIOW Ne onNUUODUT 
Ty op oyuesodwios ounone jrespusiduios ou yo ‘x’ 7" J 
*[ 2MUd soUdTETJIp ey Inod JaBLUIOS B d}SISUOD “UOT]HULYOS | 
op osevyjeo oy ‘oseyd oromuoid eT ‘saseyd xnop us aseyeO 9] 
OM] B ISISUOD SJULSSIIDJUT SPT SUP) “UOTTHULYDI,| Op IITTe} 
PR] & JUOWIOATVIedUIOD ‘adIspow sd asuoda-uoU Fv] onbsioy 
xnoAnuus jusuasornonsed ysa vjag ‘yJHompoid spopouwr ne 
yoddes sed sreiq sues yso queynsar T° “7 mayeumnse,y onb 
Joye .p sjqeuuostes snjd oyo-jnod jsd.U I ‘aseyeo oy Suep 
Ty 9} un ost]WN uO nbsioT ‘JUsUasuddaI 9] JURAR SoNUUOOUI 
qyuatos ‘amoyeaye isenb ssuodar ap sapour 9] dIIp-e-1S9,9 
‘(¢T) uonenbs,| suep *Y op sayuesoduios soy anb ayqissod 

jso [I.nb gnbipur suoae snou ‘oyuopgogid uonoes ve] V 


gsuod9.1-uou 
vB] Anod osvy[ed 0 UOTHULYII,[ Op 9s"[VD = ¢"°6 


UOT[HULYDS _p dTTP} RT] B JUOWIODATeIedUIOD o]qIey 
so 7X op uorIsuoUIp ev] onbsio] spuesis yUOWUUeUUO}2 NO 
s}jod jusuUeUUO}S sptod sap asmpoid sed ou yreLmod ayo 
‘quod ‘oxy QUenb oun p ‘odnois sw 3] SULp JUOUIITS 
onbeyo op Ioea ey oIp-e-jso,0 “'D soy UOUIOANOOTJO 
QUUOJSYIIEI sMeSUT] spoyjoW ey] ‘oMpoid sed yeunod 
OU dST[eIOUNS JOVI ouUOTIOdold yuoWIa\snle red spoyjoU 
eT onb ojquiosud un osmpoid yexrmod 10-a]]90 ‘omeouly 
Qpoyjoul ve] op seo a] suep synesoU oO JUdANEd dBKIRO 
op splod say onbsind ‘onb suojoN ‘spiod op oyquiasusa un 


900Z aiquisoap ‘ajeanbue.p senbiuyoe| 


yuasinpoid xnap soy Is — (J*p)dxo = mM op yuowsjsnle J 
yiesouuop onb myoo onb osevyeo ap spiod op sjquiosua 
SWS 9d] yNpoid oMeKoUT] spoyjoU oye0 ‘"p op oimeu 
R] QUUOpP jUR}_ ‘sJuRpuodal op UOTTWURYDE,| od o8ejeo op 
uoyenbo | yeysyes ‘snssop-19 {{2Y %} eB yuowromenuos ‘nb 
sjuepuods1 op uo][HUeYdE-snos a] mod spiod ap ayquiasua 
un gingjeo uo ‘[*p,_(/x'p!n 8%) (*x'p SZ—*7) + [Jv =m 
onbeyo juexly U_ ‘sofN][IO _ So] Mod saoLnRorpul soyqeLiea 
op ousT] mn9}00A uN ‘"p jos 39 ‘*x op UOISUOUTIp ey] NeOANOU 
ap 3S9 J No ‘aT[Ie} Inoy soide p sadnois g us sagysnfe smayea 
so] Ireday ‘soide-19 yWOap jsd 93x90} a] Suep saddojaaap 
SISO]Opoyjou eT INS spuoy uOyeUMso,] suep (by) / 
ap sogisnfe smoyea soy JoIsoquI.p usfow anne uy 

*« asuoda1 
op siouassouroy ke odnois» uorssoidxo.| nop ‘asuodeal 
op suiqeqoid ourgur ev] (UoWdAneUTxoIdde) ev odnoss un .p 
yUOWUST9 onbeys onb ssoddns sysoidde ayj0_ ‘omoyegye isenb 
aseuUOT]HULYSS-snos jURAR sIvU ‘oseUUOTTURYDE soide 
¥ JUST] & oNgLe sseuuo][HueYd9,p spiod a] }sa *™M 49 
‘puodas nb (9),7 ap UoT[WURYD9-snos 9g] 4S (2)¢ ‘9 adnols 9] 
suep ostidu09 JeUISHIO UOTTHUYDE,| sp onred ef so 7 no 


“a ( on Tein ea eridvey.: 


: UoHROHeYS\sod v] ap sed 9] 
suep SUWUOD 9 adnoJs 9] suep ¥ JUaUUSTS onbeyd mod BLO 
splod 9] oynsus synojeo UG (by) / ap sogysnfe smoyea sop 
SO]]Ie} SOT INS JURPUOJ 9S Ud S]IsNTOxS JUOWATFoNnU sodnoss 
DQ uo uolnueyss.| ostAip uonb sind “uowooydxe b 
dUISd UO] onb spuvUTUOdaI & (9R6[) BPW ‘asuodgs-uoU Pe] 
B onp uONeIspuoda. ve] op souRLIOdUIT,| Ja;O.NUOD op UIFY 


gsuod3i ap 9yI9UISOMIOY & SedNnOAD = 7°6 


‘saguuop sop onbysnejs osAyeue oun Jed WOU 49 S}IPOUTIOD 
RB] 19 SOUR] QUIASTeIA PB] Jed yUoWOTedtouLId ssanoul yuos *Y 49 
(-) £ ap xIoyo seq ‘(9MZIOANOd dp S.Md.119 soy Inod onb tsure) 
asuodss-uou ev] op JosLuo0d mod osejeo sed uonelspuod 
PR] Op uONesiyN,| op oyueddey assaqrey oun JouUMO}UO0S op 
Issne joullod stuordwi0s 3+ ‘aseyeo red yuowsyordurt (-) / 
op onouvied oy Joumss e sind ‘a,dwoo uoyNURYd9,] op 
asuodar op jUdUId}JOduI09 9] JURSITapou us *Yy op 10 ()/ 
OP ULIOJ LI IISIOYO B 9}SISUOD d[qQvuUUOSTLI STUUOIdUIOS UA 
‘squnpo.id 379 JUDAIOp doURLIeA 
ap suUOT}EUISS soy onbssoy ‘ayURSINPEs sd seed oT SURp 
asuodsi-uou ev] mod uoydd109 ke] sp UONneISQUI.| yO nb 
DIPOUMUOD v] ‘SUTOTURSNY “OJTe.UOD Np UOTsedsns oun od 
(PO0Z) ity OA °*x onb uorsusup owrow ey e 7Yy anbsioy 
ansojeue oseyeo a] onb sovoyya sulour yso souuop “Yy un 
30 (-)/ oun Ins s9puo} SsuOdaI op d[SpOW Np 9300p UONRU 
-1]S9 | onb sed puayue-snos ou epag “d “UoNnestwuopurs-isenb 
op gapour np onoweied of mod juasIoAUOD yOIp 
moyeuryss un 4so b yo ‘[(b"y) / + []"2 = "o ‘syuepuodsi op 
uoT]ULYD9-snos 9] S90, g NO **x*x4y ta SZ_('x!x'y!o 82) 


andojeyeo ne GqX-100-ZI ,N ‘epeueg onbysyeis 


x (1x So SZ—) + ty SZ = OM “Yop uoNestuopuel 
-Isenb snos ouusXsow onbyeipenb mod. suep sJomsy 
ynod osreyuourgtddns oui} un nb susrjnos & (Z700Z) 191104 
“AMLIDANOD SP SAINI Sop JUD O] 
Iod a quodsip sed yusWTeIOUSS jS9,U 9}d9NIp yUoUA\sN[e /p 
spoyjou ey “’x onb uolsuowrp owe ej WoOAe sed yop ou 
‘y steur ou no ajenbua | ev spuoda ajo nb ‘ssuuoy]yURYOS 
gun onbeyo mod ‘yY ms wUoNeULOJUI,| op wornbor 
apoyssu ayo juouajoomp “(p"y)//T = "d ‘soyfenpratpul 
asuods1 op soayiqeqoid soy Jownso,p gAessd yuo mb 
xnd0 JUOS xnNoIquIOU ‘a]e}0} ssUOd9I-UOU op ddUaSoId UW 


gsuod9.1 op aJapoul UN ,p 93191]dx9 UOneUINSy °6 


UOISSNISIG. °6 


"% OE Op WEI oyTUDppoel sInoyeurss 
xnop sop JHeoI siveiq a] ‘yWowoAnoodsai ‘o% ¢‘Q[- ap 
19 % ('6— OP Wea SossLUIOD UOU UOTesLUKoUT] Jed sooueLIvA 
sop Jneyer sterq oy “2X4 “7 op soueuea ey] op UONeUINSO,| 
ap slo] % 7'Z- 0p 10 NT “7 op oouenea ze] op UONLUINSO,] 
ap sIo] % ET — op mere (Sie vB UOWaANeIeduIOD) sisnfe 
CIS4 INDCUITISS,| OP JVJOI steiq oJ (% | snjd ne.p yed9) 
soyooid son issne yuoreya (3 “7 yo NITY mod “Sten 
o[dwioxo Jed) sourLeA op smoyeuse.p oiled onbeys op 
sonbiidura ssuusAour savq *(°% | snjd ne.p ye09) sonbridua 
souusfou sonbnespenb simouo smo, jos os SUIWIOD 
“(% 10‘0 snjd ne,p yed9) sonbyuepr onbsoid yuoros 2 “ 
ap 79 NIT“ op sonbinduis souuadour soy onb yueuu0}9 sed 
4S9,U [I Juonbgsuos Jeg ‘asuodal ap ajapour a] snos (UOT}eST 
-Wwopued) aseuuo]]HueYs9 .p uvjd ne yoddes red syuas1aAu09 
quos “7 op smojyeuNso xnop soy ‘suONR[NUIIS sp o[quiasud 
309 sue ‘(9°68 UOMAUD,p jeR}d sJuepuodel op UOTTHURYDE | 
op ouudAour a]jIe} e[) sJuepuodsl op UOTTMULYDI,| op onIed 
OMe} ap saouvyo op % OL UUOTTHURYDE JUOUUSTA onbeyo ke 
yueUUOp Ud sIeUr ‘oes odeUUOT[HULYSS .p ued UN jo UONR] 
-ndod swigu ev] JURSITWN Ud sagynoexad 939 UO (SogjUasoid 
uou) SUONRINUISQO9 | Op squissua sWIXnep uy 

‘soqesiyn 
JUITQUIdS “UOT}DOS dJUdSOId B] B DIDSBNS 4SO [I SUIWIOD 9SLLIOD 
uonesiesuy sed moyeurnss.| doAe ao-jned ‘ayuapgooid 
UONIES FT B SONOSIP dOURLIVA Op SIMoeWISd soy sJOTe 
‘yey dT UO IS ‘adRTeD Op Ma}eUISd,] SUBP 91901109 asuOdgI 
ap sJEepoul os] JOISOUI.p UOU NO sIQeIgJoId JOS [INO 
"syeyNSOI 
Op JSIIIp syquiasus un snod (pN0Z) HOY 32 WNOID MOA 
‘JUSUDTNAS oSRTeO Op sorqeleA xnop jULyOdWIOD soguUOp 
op squissus un.p Imsed e suonesi[eioues sopuRIs op oIIey 
ap sed yUdIAUOD OU [I ‘sIOJano], ‘ajapour a0 sed peIsgUI U 
mb ‘NIT “7 gp aqjao aonb ajueyoduur snyd °% ¢] ap snd wee 
‘91991109 asuodal ap a]apour 9] WesSgquI mb “4X4 “7 ap onbu 
-iduia suusAow onbyeipenb moo, “AIWOd.| 9p svoyyo 
uoneurrxoidde sumos 54 op uonesiyn | op sioT 


SJINUSANOD ap SiNaWe Sap 18 BSUOdaJ-UOU Be] Bp UO!I}OS09 eB] JNOd aBejeo ued uoljesgpuod e] ap UOT}eSIIA : HOY QG| 


ansojeyewo ne Gq@X-T00-ZI oN ‘epeueg onbrsnejsg 


“OSATRUR | OP SONJIXd 939 JUO 


SUOT]EINUITS $9 ‘Xd “) nod suonessyt xIp ud ayuTONe 919 sed vu soUdSIBAUOO vy ‘soeJUoUIg|ddns suoNEINUMs anenb sueq , 


(10000 >) L8°€I- 


(rL‘0) €€0 
pean (1000°0 >) 60°b 
: (1000'0 >) Ls‘8— 
9p WsgyIp (1000‘0 >) 72°81 - 
(Ss‘0) 8I‘0- 
(€000°0) 09°€ 
EUSA (1000'0 >) 60°9— 
op JUAIOPIp (1000‘0 >) 96°61 — 
iy (9s‘0) 85°0 
op Jorg yIp (Z0°0) 6L°7— 


(jelaIeIIG UOTFOYTUSIS Op 4S9}) 7 NoVA, 


(laxal()ZL8q) ANAg) 


(010°0) Over‘o— (laxa@cis, — INM@1s,) 


— 6500 (laxal()ZL8,) qeajol 
sonbysyeis sonny 

lca LOT qAINOd 
(€L‘Z) 00°LOI “A 
(36‘T) 6L'88 Tas 
(pS‘T) Z1€L . aA 
(001 = (48a) Nag) AXA “GD nod soueteA op sinoyeuNs” 
— S£'66 qAWOd 
($7'Z) 69'P01 “A 
(og‘1) €s‘s6 gis face: 
(€S‘T) 6S‘€8 “iS4 
(001 = (48a) Ng) NIT “] mod souenea ap sinayeuns| 
(90‘0) +0°001 age 
(90°0) +8°66 py 


(001 = “z)“z nod smayeumsy 
(odA}-1ne110) onbridurs suuakoyy 


, SUOTLINUIS YOO | IMs segseq sInoyeuTsa sop sonbrrdurs souuakoy| 
J hesqey 


‘sqquapaooid suonjoes xne JustUONbI0Sy} 
QNUOUTAP SUOAR,] SNOU dUTUOD ‘sIeIq sues jUotUaNbIO} 
-duAse JUSWISATOOTJO o9-jnod JUSIv}IO DOURLIVA Op SiNd}eUt 
-1sd soy] aonb sosuad e yuouuop 39 (% ZT & S‘p Op) sined 
JUDWD|QVUUOSTeI JUSILIO SII ‘SJIVOIJIUSIS JUSTIOS sIeIq sad onb 
udIg ‘o[qiey snjd yUoWIOINSS] IMsyeA ouUN,pP sgoxa Jed sTeIq 
un yreyuaseid 44 oy onb sipuey 4nejop sed sterq un.p syorjue 
yemourap 4 “7 onb isure “7 “7 mod gysnfe “48a oF 
"xneso ‘UoUaATOAdsaI 
Suos “oOo 49 (b‘x), v4 'p So] sno} onbsioy ayoexo 4s9 
ouyeso-isenb ey] Coe Ome C2) 7 JQ S9]PLI09 
uou 73 soy doAv JHOIpsid stapout 9] snos ‘onb suojON *(u/T) 
40 +1 = *x(b*x),f 7, ({x'x(b ‘x), f “0 8%) "x —] = 40 
no to/;U= eyed YU onbeyo yuedsedurer uo “Sa 
op jenjouod juswiajsnfe un ginoyeo suoae snou “(a yo 
ONUd 11ed9 | OIINPSI ‘oIpP-e-}S9,9) UOHesIesUT] Jed soURLIeA 
op smoajeumso sop onbrnojduidse., Jorgjg00e +=Inog 
‘opTuppyoe! smoyeur 
-I]SO SOP Sed oT SURP sonud}e snjd ano quosstered “XI % 
1 NT % op sopueis juowoyonjiqeyur smoea sop e 
so1oosse soulayqoid sayy ‘anjosqe mayea ua *a say onb sayqrey 
snjd juowsyqeiooidde sgioosse “% soy ompuol e s0uepUd} 
JUSTRAR spueIs yUoWOTFomIqeyur X41 Mn yo NIT %y say onb 
J[QUIDS [[ ‘puRIS UOUTUUUUO}S JnvJop Jed sieIq UN JUdTeAR 
uonesuesuly] Jed soueleA op smojeulsd xnep sa] 
‘CIS4 yne yoddel sed sagnoyeo 919 JUSWIETeS9 
UO neayqu} np ansed 34300 mod 7 sMo[eA soy “ooURLIeA op 


ZS1 


SINDJCUNSS SO] SOAB JUOUIDIIOJ snjd ag[9a1I09 1e}9 49 (s}IvON 
SOP Sd (YQ9 | Sop suUDdAOUT PT & WepUOdsaOD ‘OUTOU-sT]9 
‘mnb) ayuepuodsaio0s AIOA,| op onbrrdure adAq-ma.19 | op 
sour ey uomAus year ‘2254 gsnbeyo onb sored ‘sonbudurs 
souuaXoul sonbyespenb smo soy onb yoynyJd nevayqe} 3] Inod 
QOUdIZJOI op SMITA sUILUOD sIstoyo 919 Uo “484 saq 
‘oATVONTUSIS sed yiej9,u (184 
op onbimdurs suusAour eI 30 IMOeUISD 399 BP AIO. I 
onus souslayjIp ey onb Imojewnssy, sp suussour onby 
-eipenb Maa] ep s][qIey JUSUIDT[O} oJUeSOduIOD oUN }j1e}9 
10-INJ90 ‘JeoyMsis onbundurs sreiq un ye NT “7 onb uoiq 
‘onb o[quids |] ‘JUvAd.Op nod uN }1e}9 yRIINSOI 9D “g1D0Sse 
mayeulysa | ap (GINO) onburdws suusfow snbyespenb 
INIA ,| Ip WyUdIaJIp JUOWIDAyvOTIUSIS onbuidursa suUdAOUT 
oun yeaeu “Sq unony ‘QQ & saye8e quolos synoodsoax 
(2184 gap sanbuiduia sauusour say anb 9110s ap sasi[eur 
-Iou 939 yUO sonbridwuia souusAowl sonbyeipenb simo1o 
SO] 19 DOULLIVA OP SINDCUIT]SA Soy] “INd}eUIIWSd onbeyo nog 
"9]901109 asUOddI ap S[9POU 9] INS SPUOF 389 JOTUJOp 9] [Nas 
onb sored Jueuuoje sed yso.u epag “4X7 “7 mod seo 9] sed 
3S9,U 99 $60‘Q Op UONVOIUSIS ap [INas Ne QO] Op JUOWIOATO 
-yrusis orayyip NT “> ‘srerq sues yuowronbneid yuoros xnop 
sno} onb uatg ‘Q0T= “z anb ouos ap sestjeurou “7 mod 
SIMICUISS xnNop sop (SUONLINUIS QO9 | So] Ins ouUDdAOUT 
e]) sonbindura souushowl soy ouuop | neaqe) 97 
Tay = (x), f jo ( (ao) x)dxe = Cab ay 
mod {= (bx) f= (6’x) f 4) mog 


<dxXd 4) 


900Z eiqwesep ‘aj}enbus,p senbiuyoa | 


Ax“ mod no NIT “7 mod souewea ey op moyeuUNso,| 
Jgmnoyeo- yenoA uO onb uUoOTEs jyUoWOJESO] JUOTeIOTJIP 
Ta yo “4 op sjnojeo soy onb Jousinos op juorlAuOd [J 
‘suostereduroo say nod ror ayn sa. ‘7484. ap qnoyeo 
9] SIeUI ‘NuUOS yUStUAIeI ySo *a ‘anbryeid u_ ‘snuUOD yUATR}D 
‘d 0 no “A'ix!d(h'x), f 9% (xix'd ('x), f 9%) "x 
—4= "a sed govjduisr % ooae aginojeo 939 yUOWOTeSO 
e “IS g9q0u9p UonRsLIesUT Jed soURLIeA Op mMo}eUINSE | 
Op UOISIOA oMOT][IOW oUN ‘UOsIeIeduIOD op suy xny 
“sogqnoyes oo up 
qUO JUOWOTNEs ofruUyyor! sonbydo1 z7E aonb oyos op ‘soddess 
anenb op oun.] & JUOWONO}VITe sonquUye 99 JO ge]Xs 
onbeyd suep suo]ueyoe-snos 9] sat ‘oyduunts snyd opmmpyoel 
np j~noyeo oy ospuo1 mog ‘(g[)uUonenbs |, sed stutyjop 
osvUuUOTURYOIEI op spiod sa] daAe (TT) UONeNbe,| suep ‘a 
‘gsodoud opruyyoel 9] (77 39 (Q]) UoNenbs | red tuyap YY ooae 
(O[) uonenbs,; suep ‘Sa ‘uonestiesur red moyeuryso | (2 
JUSTIN UD SOOULLIVA SOT SUUIISD SUOAR SNON ‘(« DOURLIVA PI 
op UONLUINSd » a}INs eT suep dgfadde) suudAow onbynespenb 
INDLI9/SOULLILA PR] Op UOTLUITSS | SULp oTUIZ UOTe{Ndod mod 
UOT}D0LIOS I JOJOUSI.p sted v ayes onbeyd sp uoNendod 
RP] & JUOWOANVIedWIOD UOTTHURYDE,| Op ale) aWod eT 
Pie ete (wr? 
® aap? mod (XO + nO 1= *@ enb juowopordut 
yesoddns HAYH moyeurnsd,'T *9}001I09 asuodai ap sjapour 
9] SNOS UOHesTUOpUeI Op SUOTIPUOD sop sUEP JUdS.1OAUOD 
ney 4 mos sie “(%’3+g%x= 4) npuoqua-snos 
JHopeid sfopour sy snos sieiq sues JWUOIKID sIMo}eUIT}sO 
xNdp SIX] ‘gsI[e1ouas JHeIgt jouUoHJodoid yuougjsn{e ed 
Iayeursd uN }1e}9 puoses 9] onb sipury ‘OAYH moyeurysa 
un 31e}9 Jomuoid a] ‘sdfLI9A jos osejeo op uoWenbs,] onb 
OYOS op spUUONII]IS UoWoANoedsal “WUAIe}D (4,.)b 39 b no 
WAG ee be x \dxato Set, “pone ys A(D Ix 1) 105% 
= NIT “7 gone ‘suodsey xnap op sus 919 & “7 [e101 OF 
'9°CG UOMAUD Pp DUUSAOU 9UN DOAR “OT | B B/ Op WeLIRA 
S op oye} eT ‘suonefnums 099 | soy sueq “"x op uoONey 
-ndod op ouussou ej yea “py no “(*p/ "x s¢‘o—)dxa 
="d ‘eynomred uo ‘{*x op oye, ey ove yenunuip 
mnb ‘¢ ‘syuepuods1 op uoj[HURYyo9-snos sa] suep ojuasoid 
one,p wIqeqoid sun osnqiyje suOAe snou ‘soguUOT]HUeYOS 
sgyun 7] sep ounoeyo y ("x ‘T) = "x suep "x ap “C/d 
giqeuea ey jo “ op IAIOS ® CRLINY Wqeuea eT ‘opesour 
d]]1e} Op soyens yNy sop sunovyd suevp soyuN g] aUUOTOOTIS 
suOARe snou ‘aynens s[dulis omoyege oseuUOT[HURYOS 
Jeg (079 §=N onb oyz0s ap) sloj QZ sogadoai suoae soy 30 
(7661) URUNOI\ Jo UOSSUIMS TePUIES 9p 17MIN SoguuOp 
Soy suid suoAe snou ‘omey 99 Mog ‘sol[oeI soguUOp sop 
DOAK JUDWIDAIIJJO JUSUUONOUOJ S]I,S MOARS B JOYDIOY op 
yuopnid 4so ]I ‘xneaanou jos (g]) uoNenbs,| Jed soumtidxo 
gruyyoerf =oseuuoyueysser op spiod soy onbsmg 


snbruidwis adwiexs ued uy, *g 


ansojejeo ne GqX-[00-ZI .N ‘epeueo onbysnyeis 


‘9[e10} osuods1-uoU 
eR] op onb Isule ompOANOD op IMOLId,| op UOTNdd1I00 
RB] Inod uonesiyyn uos gsodoid yuo si] "7 19 D ‘Q smMoyea 
op s[quiosuo oidoid uos jurAe ouNdeYD ‘oseUUOT[HURYOS .p 
soyTUN .p Sasse[o sto. yUR[Nysod ud aydnos snyd s1O9Ud HAW 
3] Suep osvieo Jed yuowsjsn{e | npusl yUO smayne so] 

‘USO UOS JUSWSATOOTJO ISO (Q) f =D onb 
stpur} ‘(-) f ‘asnjpo and juawajsnip | INS SdUIOG IP JUdAIOS 
1% Tsingea saq ‘onbystso] Jso (asuodal ap no) aimyzaanoo 
ap aiiqeqoid ey ‘Wp yuouronne ©, [(p*x)dxa+]]= "d 
T=7 ® ‘w= ‘T=D IS Juowonepug (p"x—)dxo 
=X) S/1="40=T BP “w=NT=D 18 ‘onb 
suOAINSGQ “« HAI» no «[e1ouas joyuouodxe sjapowi » 
op wou a UoTssoidxo 93399 B JUOUUOP s|[ ‘soouTUUIO}opaid 
sojuRjsuod sop OS NSO>T PW ‘oS Q>1[0=ZT n0 


(o*x)dxa(7-9)+(9- 7) 
(9 - AT + (9"x)dxa(7-9)A 


(OL)uig: = (9x) f 

: O[QIXOT] QULIOJ 

ye (-)/ & JoUUOp ap ano Ud yuasodo.ld YsuUIS 30 WoslOy 
‘JonjUdAd oTdIyNUU JUStUSIQUIOUSp Np asneo ke | & noLIedns 
ong JURUSJUTeW ynod nb oIquioU ‘esepUOS ap oseq Fe] SULP 
yuosoid yso y onb siof op nagid oiquiou 9] yUdTANp (¢][) UO 
-enbg,| suep *d op uonuijep ey ‘opoyjeur Ino] yueAINs ud 
soyey o.9 yUOANSd yUOWMOIQUIOUSPINS Sp jo -sNos op UOSTeU 
-Iquiod oun no (a]diy[NUI JUOWOIqUIOUSpP) JUDWWOIQUIOUSp 

-INs oy onb sJonbiewo1 yey yO yYsUIg jo Wosfoy 
‘yp yuouoidoid aseyes 
Jed simoyeuysa xne jUoUOAyeIedWIOS sTqrey so oUUdAOU 
onbynespenb moo oun jurke no IMoLa,p sonamodgp 
Josoddns ynod uo onb sgyquenb sop 4 mod oasrjeo 
OP I[QIO SUIWIOD JOsT{HN ynvj [I UoNRoyHeys}sod ve] ap Jorn 
-Iyed seo a] suep stuUIo0d ‘sonbruoydey]s} soygnbus say suep 
s9sI]yN JUSANOS UOHKoYHeNS\sod sed uoyda09 ap snuuOd 
uarq onbyeid ev] op UOIsUd}xO OUN jso od¥RIeO Jed oIMjJOANOD 

ap Mod ,.| 9p UOTIELIOD ve] onb JouSsI[NOS op JUSIAUOD I] 
"JUSUTSIQUIOUSp-snos 
np juowyIey ne sosodsuvy ano ynod asuodss-uoU Pv] JOE] 
op ona ud osryeo sed uoneIspuod ev] op uonesI{yn,| mod 
IDIOQE]O SOS} LI 93NO} sIJOye ‘soyURpUddepuUT jUOS oseUUOT 
-[Hueyo9,p soseyd (9 & Y Op) SWUgIxnep EF] 19 (GY BD OP) 
alomusid el IS (¢]) Uonenbs | Jed yUSWID}D01I0N 9SI[SpOu 
yso 4 suep wos Q>Y¥ youse, onb syIqQeqoid ey onb 
suosoddns snoy ‘79 380 onbyoyjodAy ayaydui09 uonendod 
eB] onb sipur} ‘7 JUSIANP asepuOS op aseq ek] op UONendod 
ey ‘nuuod ane Op “ZF Moda 9] aTjonbey; mod snbryep 
-odAy aa[duioo uoneindod oun,p jueusaoid uossiog op 
UOT[HURYOS UN 4so aBdepUOS op dseq YI B B9ID0Sse UOT}eINdod 
e] onb suosoddns snonN ‘91 Wos Jeo1 uoT[HURYD9,, onb 
JUBAR JUSUTT[aN}ddNU09 Nar] B OseUUOT[WULYDI | op ‘oMOVeOTL 


@JINUSANOD Op Sunde SEP }@ BSUOdaJ-UOU FB] Bp UO!}DEI09 e| JNOd aHeyeo sed uoNesapuod e| Bp UOHeSI|NN : Hoy 9S| 


ansoyejeo ne GqX-100-ZI .N ‘epeueg onbrsneis 


isenb oseyd ey ‘9}xO]U0D a] sued ‘JUOUOIQUIOUSp-snos 
3] mod s9811I09 mod onbiyjdde ang issne ynod asefeo sed 
uonelgpuod ey op uaXow ne ssuod9s-uou ev] op JUOWO}e 
a] onb sonbirewor yey yO (QOQ0Z) YsUIS 30 Wosloy 


91NjJ1IANOD BI Op UOSTPVPO| °*L 


‘asuod9i-uou 
op sed year AU [I,S UTUIOD gfnoTeo a9 nod ‘a ‘T=(Q) f IS 
‘neoAnou oq ‘(Z[) uoenbs | op ayruypyorl os euuolHUeYyosel 
op spilod sop oyuapiaAg uonesieiouss oun yso mb 90 


sau 
(oT) n(b ay) fp [xiacb'y, 6% |» 
a 


sau nau 


[oxo ™oy" XK ky ze Je (£2) An Hay (fn) ay 


: uypyoe! os euuo][HueYdIeI op splod sop apre | 

B ginojeo ane nod ‘/a ‘oyruyyoel gy ‘(] [) uoenbs | sueq 
“x7 = TY no seo 
3] nod suonyr}e}sUOd $90 je} JO (p66) JOyeg 30 UTySsnoT 
Tony ‘oy/[="d :o{qeueu nod suoj ap osuodo1 
op ajiqegoid op uonouoy oun e puodsaios f aye0 “uoUT 
-asnomoyjepy “Sa ouuaXour onbyespenb moxo/soueLeA 
RB] Op INd}vUISd | Inod TeJA JUSUTATeSd 4S BI9D ‘asuodsi-uOU 
ounone yeae AU IS ouWOD sgynoyed wos (QT) UOn 

-enbo| op 4 soy 1 ‘T=(9),f ‘omegury isa f puend 
(91) uorenb9 J ed tury9p 
nedanou op % ooAe ouuaXow onbyespenb modo/souerleA 
PR] op IMoeusa ouwUOdD sasITyN ona jned (QJ) uUOn 
-enbo,, ap “Sa ‘sagious1 ang mod sojqrey yuourUesTNs 
yUOS gisop JoMUdId ap UTES Op soy[Iqeqoid sayz onb 

30 soisap sinoisnjd pusiduros 901 UoT[HURYDE | onbs10'T 
‘osuod9J-UoU ap soUaSge ,| US SUTOUT d7Te} a.N9 nod 
oq “9 ureyioo un mod “9"x = 70 yo ‘sagjgui09 uou yuos 73 
soy puenb yHoIpsid afapouwl oy Ins sogseq sayotidoid souu0g 
op URAL SOURLIVA Op INd}eUUISe UN SUUOpP UOTNANSGNs 9399 
‘(g) uonenbs | ap “SSa ane yuosIoauoo snjd “°° yrempuar 
mb a0 ‘u("u—q) im SX sed onb yond v(m — 2m) SX 
red guiyso jso (¢]) uonenbs | suep "x / Ja("u—T) 2X onb 
suojoN *’a yuedeiduiar Y% cove (¢]) uonenbs | ap siquiou 
SUITXNap 9] stUsa (L[) UoNeNbs | op siquiow swErXNOp IT] 


LAY 
gel gay¥ 


1) “(ulny( Utm)[ Mn (fut ai 1)] RE “<+ 
S>4 
(im — Jn) Ree me 
d0ak oUUdAOUT onby 
-eipenb Mo119/SoURLIeA Pk] Op IMdyeUIsd UOg uN,p Joyoodde 
snou suoAnod snou ‘{e19ua9s asepuos op urd un mog 
‘Ind osvuUo][HULYS Pp 9}x9}U09 UN suEpP 
“4 ap oipuojoidde snjd uorssnosip oun mod (epQQz) NOY 


GSI 


HOA “(000Z) "Burs Jo Wos]o,J sUep QUUOP yso (QT) UOHeNbY | 
suep JHINUI UOU UOTTHURYDE,p NpIso1 np juared syooid 
uQ “tax yo tuts "m onbsind ‘sopqrey soyurequos 
sop snos uonestwopues-isenb op s[apoul a] Ins s9puoj 
suuskour onbyeipenb moo] op 30 JHOIpesd syapour a] ns 
DOPUOJ DOULLILA PI OP S|QLUUOSTeI Mo}LUIT}SO P SIOJ LT & LOS 


sef 


sat 
(91) “i y(b'y), f'o ‘xia se ete 


one (im — Im) °X 
= “a sloje ‘UossIog 9dAj op 4So [BUISLIO UOT[MURYDY | IS 


{A} 
mit : nef 25 
(St) -(‘usfayCuy%ay(futu — "ny I + 
1)? 
Yu /Ja(*4u— 1) (X= 
n=l 24 


(fur ja)( tary Ya)(Ltu 9a) "x 
Fhe ewaet er 

juowaaneurxoidde yso TY “7 op uonesmuopurs-isenb 
snos suushow onbyespenb moia.J aonb suoAoa snou ‘(p7) 
uonenbs| ap jueueg (oy) f= "d/T 1 "u/T= "Dv onb 
suopedderyo “"d"u =u jog Mqiqdiy = Bae 180 sjuepuodar 
op Uo][HULYOE-snos 9s] sup stiduIod xnap sno} jUdIOS 
‘L#y‘f yo y¥ syuowgfa soy onb gI[Iqeqoid ve] aonb Jd}0u 
Jed suoSuowmuo0s snou ‘(asuoda1 ap sj9poul oy] snos uony 
-PSTUOPULI OP SUONIPUOD Soy SUBP INI}eUIIYSI | op suUdAOU 
onbnespenb moua,] ‘amp-e-yso,9) 9 “7 op uonesnuopuel 
-isenb snos suuaAour onbyeipenb moo] Jouss mog 
‘yso,] 4 (o"y) {0 SZ = 7 puenb sayqrey soyutenuod sop snos 
uonestuopuel-isenb snos yuassaauos sa TY “7 ‘ouog 


(pI) (un) 40 +12 —a(gty) fv = 
(u/N)70 + 

Yaty(o%y), {0 C(o—b) + "aK - *a(g*y) {0 = 
(u/N)“O + 

Ya(o— b) *y("y), {0 + 1a — *a(oty) {0 = 

‘al f— (bly) f}%0 4% — alba) f0"S = 

TT NINN 


: yueamnsimod ug “(u/S/N)70 = '27u(o"4), f 
tS onb oyos op snéduod 939 JUO s|~T ‘snuuOOUI 
neaanou op jyuos 7a soulia} say] (o! wWf/i=‘d 


“cua g wf OR (xin ai), SOX) =" 
no 


a" ¢ —a(by) fp “¢ = 
n3Y $3 


1G EX rs "¢(b’y) {to { = Fic To 4% 


900Z eiqwas~ap ‘ajenbue.p senbiuyoe | 


op Indie oun eB TWO %) INd}VUINSd J 


(u/)70+ 
[xu se <-"1] 1 Lx £0 <]} = 
(uX/1)7O= 


s3! sof 
oacer | ‘x'u/(b'w f'0 |= 4-0 


sJoye “(ayfnu steuelyso.u _ f onb 
duop ‘auoj}oUOW 3so_ f onb suojodder) ayIqeqoid op oyu] 
RI 19 AN desteoi uoNefndod vj mod sioj vy & I[QISIOAUT 4s 
N/'x,a'(o'W),f'9 °< Is onb e209 ap g[noogp TT “o"y 19 
by onbeys aqua ostiduios “9 omeyeos epuess oun nod 


(UN/N)70= 
S37 S27 


*x[( — b) "y("9),/ 1" << = "x7 u) "0 "7 


qugjoags ((b"y — o7%y)("9),f + (by) LS 
=(o"y)/) ouussour moea ek] ap osuwolosy} eI 40 
sosoyjoddy sou ‘’x(b’y) fo °< = “7 anbsing ‘snayoaa sop 
UOU 39 SoreTeos smMayeA sap yuos b*y 39 OY onb suojoN 
‘uonestuopurs-isenb snos sajaudoid sos ms jojjo unone 
BU JnoIpeid syopow ne yodder sed sreiq sues yso TY “7 
onb uou no yuoWaTqeuUOsIel JoIejosp assind uo] and) 


uonestmopue.s-isenb snos 
suusdow snbyeapenb 9119 ,] 9p uonvUInSy 79 


‘JeUISLIO ssvUUOT]HULYIE _p 
SUUSTUBIOU ds] JUdUOMeSss09U sed sie FHoIpoid sTapow 
9] dUIaNUOD INb 90 Ud d[QvIOUSI 3so asUOddI Op SUISTURDOUT 
9] puenb amp-e-yso,9 ‘9 =({9 3 3|°"7 “4 ?x}|"3)q puenb 
SYLIQA yso (Z) Uonenbs,| op Jnoipoid oapour 9] Is steiq 9 
aNuUOd UOT}d9}01d SUTRLIOD OUN dO aseKTeO Jed UONeIspuod 
e] onb Jowsyuo0s ynod oassoiguI vjao onb mop a7] 
‘QUUO][HULYOS so [I,s puodar y ‘Is yuouonbrun yo ‘ts T= °*7 
J ‘JeUISTIO UOT HURYDE | SUep yUdSoId jso y ‘Is yUoUONbruN 49 
ts T= "7 no *"7"7 ua "7 Jasoduioosp suoanod sno 
Juorpead 
Q]2pour sj suIa0U0D INnb 90 Ud d{qQvIOUSI sed jso.U ‘osuoddI 
RP] suduros A ‘aseuUOTURYOS .p SUUSTURSOUT 9] “Ip yUOWO.QNe 
0 =({23 3|77"x}|"3)y vou stem ‘9 = ({7 > 3|"x}|"3)q 
yuosseysnes (7) uonenbs,| red suuop syapow np *3 soy onb 
OALUG JI ‘Isure wey] *°x = *y onbsioy ua) ap souvyo ap 
snyd ev JnoIpeid ojapour oy ‘sUBT[NOS sUOAR | SNOU SUUIOD 
(P661) HOY HOA 
‘One | Ip d9Y99,] a.QUOD asq}01d s[apour uN ‘suds UTe}IOO 
un sueg ‘(-)f ap x1oyd 30 mod 390.1109 sa (¢][) UONeNb? | 
ap asuodei ap sjapouw oy onbsioy uonestuopurs-isenb 


ansoyeieo ne GdX-100-Z1 oN ‘epeueD anbuysneis 


OP I[EPOUW | IMs soopuoy sooLIdosd sauuog op Issne yUOINe 
SINDJCUNSS Sag ‘JHoIpsid sfopour a] ms sospuoy sayoridosd 
souuog op JURA sMojeUso sop vinpold (-) / ap xtoyo no} 
MS s9puo] osx[ed Jed UONeIQpUOd x “(ajopoul np oyueIs9yUT 
anied oun ounuoo g=({9>33|77"y’x}|'3)q7 juenen 
Ud) yOOLIOD 4Sd JHOIpsid sjapour oy onbsio] ‘Wuepusday 
"sfeul 9] Inod Jnorpoid 
g[apoul sy IMod oxouuod osviveo Jed moyeusd,] dsteIq 
puor “Y suep moayea 909 op UOHONpoNUI,T “y a[ooLIse 
uoneyo[dxa | op slew np omyyno ev] e o9IDRSUOD dTJoNUUe 
a1oyiodns ej ane ynod A ‘ney snjd yLoap sayjooes soy 
Ins ajonbus | ap syduioxa | sueq ‘ayjnu sed ysa.u ("4 |"'3)q 
juowayaniqeH ‘yp yuousidoid *4 4so oyuesoduros ayo} 
oUN NO S¥d I SUOISPISUOD ‘soUIAXd SUOTIPUOD soy sueq 
‘onbryeursyqoid oo nod ¢ = (*y|"3)q onb yuefnoa JHorpeid 
gjepour np oseyjodAy., ‘*x op onb jomyd ajnbus,; op 
yuouustAold “Yy op soyuesoduios sap Is ‘onb stoyayno} sud}ON 
‘aseyeo op uoNenb9 | JWoysHes sptod soy onb jrey ne onp yuoW 
-o[duIIs }so JOIpsid sTopour a] suKp sIeIq op soUdSqeT 
‘yuoWo.NNe (39 “puodas jI.nb 49 [euIsTIO 
uoT[HULYDS | suep yuosoid jso y JUOWIZTO,| IS [= "7 ‘Q>Y¥ 
no} mod 9 =({Q3 3\77°y’x}|"3)97 no “34 g’x= 
omeouly JHoIpsid sjopour ay snos sayoidoid souuog op vine 
(by) ftp = mM no WM SZ= W “4 ap uakou ne “7 ap 
uoneUse | ‘yueaoe svo aT °*x(b7y) f° = XZ aonb Jn 
b ously] mo}d9A UN IIANODEP ap JUdANOS e.IOULIEd p UOTIDS 
RP] & OyOOp dANeIO opoujou ey ‘(-)/ oun juRYORS 
‘onbiiosy} swayqoid un 
asod omp9ooid 9909 “MOA suOT[e snou sUIWUOD ‘soyUepuod 
-SOI0D JUSWASUdDeI ap sIMayeA say onb yoynjd ‘*Yy suep 
sjonbus p sMI[eA Soy SIMNpO.HUT,p JULIUD} 4So [I “Juonbesuos 
eq “INaeA 390 op souTUIAJOpaid UOneUTxoIdde ouN,p 
onb ‘ye ua A {Inb 4s UR} Is ‘steu Np omyyNd VI B a9JORSUOD 
ayuvINoS s1dyJodns ev] ap UOTJOUOJ oUN OSeRIURARP SIOJO}NO} 
yso ajonbus,| e spuodar y ajoorse ostudanuo J onb yey a7] 
‘osvuUOT[HULYDS | JUDAD o]JonuUe ajyonbus | nod sayuepuod 
-SdI0D SINI[vVA sop soyqruodsip simoyorpoid smMoa[IOUr so] 
yUdTe}ID JUOpsoaId yUSUASUdO0I Np yURUDAOId *x ap soquRsS 
-odui0d say ‘sayjoo9r say] Ins sjonbus | ap syduroxo | sueq 
"SOJJOIOI S90 Op SIe[DEp ovUNJOA np onb 
yOIN|d Juapsooid sMA[NLISe | SP JUSUISSUIIOI NP SIO] 3.119} 
op soumuod sap no 9[q np ‘sfeu np srepoep je s]Jo,nb rey 
np juowonbrun puadap sayjooe1 soy Ins oyjonuue ajonbuo | 
e opuodsr y aoose uoneroldxo., onb aI[Iqeqoid vy onb 
oytusis 0=Y Joxy ‘oymonsed ug [>Y¥ mod x= "y 
onb sasoddns op ayqeuuosies ono yuotoyeso yIeLnod |] “o"Y 
ap onbiystso] uoToUCJ oun,p udadour ne gisnfe asuodas op 
syIqeqoid op sjapour un e yURpUOdSa.IOD JOTUIOp 39 ‘(-)dxa 
+] 30 (-)dxo quos (-)f mod smoyowoid xioyd sog 
‘aj3onbusa ,| op sayqeiiea 
sa] sayno} e onbyddes onbysyjodAy uonesmuopurs-isenb op 
Q]Opour Suu 9] ‘JHoIpeid ojoepow ne JusWIOMeNUOD °"x vB 


SJINUSANOD Op sina SEP Je BSUOdEJ-UOU e| Bp UO!}DE09 e| INOd abejeo Jed uoles9puod e| Ap UO!}eSIIA : HOY Sl 


onsojeyeo ne GqX-[00-ZI oN ‘epeueD onbysneis 


[eso yuowaTTomusAS “TY ddAv (ET) UOYeNbs,| suep “Y op jo 
(-)f ap joins ne sastui9 sosayjodAy sap pusdap soajyjoo9s so] 
Ins sjonbus | nod omoyegye isenb ssuodss op s[gpowl oT 
‘ounoeyo 
mod sanbysyjoddAy spnorposd soyopoul sap JUSUAT[ONIUIAD 49 
‘91g Np sINjNd ev] B d9IDBSUOD d1DIJJodns ve] SUTWIOD 4oIQIUT.P 
ajonbue p simeeA saynep aysIxd [|] ‘S[eUl 9d] dUSISOp 
J sorpur,T “3+ "g*x= "4 ounoy ej op “* ‘y ofoouse 
uoneodxa | Jed stew np simjyynd ey eB a91DesUOD oTOTJJodns 
ey Inod onbyeayjodAy Jnoipssd syapour un apessod sajjooos 
So] Ins oyfonuue ajonbus,J “ajIns op Isule 30 ‘sogyJoooI 
9110] op soumtuod op gynuenb ey ‘x ‘oreo[dxa ay90 sed 
I9IJOO9I 9Tq op omueNb ey ‘*¢x ‘y aooLse uoneo]dxa,] ed 
JUOps09Id DINNOLISE | SP JUSUIISUIDOI NP SIO] 99}]099I STRUT 
op aquenb ey *'x jos ‘oydutexa sed ‘saqjoo9I soy Ins oTTonuUe 
a}3onbua oun sueq ‘sonbruojoysip onb yoynyd ‘sanuquos 
-TMId9s NO sanuUOD Juos *x ap sajyuesodtuod say ‘aseleo 
Jed uoneispuod ey op suoneorydde sasnoiquiou op sued 
‘asuodai-uou ey] nod 3a\snfe mod 
IdV.J op vonesiyN.p sjduioxe un yUoUUOpP (9661) 901g 
10 yep ‘Auiog ‘sed ysa,.j ou ‘{o*x—-}dxo= "d Jqv,] & nay 
suuop nb ssuodai ap ajapour aj aonb spur, ‘g *x = (4) °*q 
‘elegul] oInewop Jnotpeid sfepour oT (-)f onbyoyjodéy 
asuods1 op UOTOUOJ RI Op 9}0eXO SUIOJ eT op JUopuodap 
nb sane .p d}stxo Ud |] ‘“aseTeO op splod sop UONeUTULIO}Op 
op spoy}olu oun 4s (TGV) JeIo youuonsodo.d yuourgsnle | 
‘syisnjoxe jyuouoTjonynut sed yuos ou sodnois soy IS 
“SJUDIOTFIP Say JWOUTATTaNydadu0d STOJayno} JOS saTspou 
xnop soy “°b/[=%d : anSoyeue so omoyegye isenb asuodos 
ap asjapou ay “°g = (44)°q : oIURMOD oUUaOUT oUN vB ‘VOU 
no spuodazl [I,nb ‘3 sdnois np ¥ yuausTa onbeys aonb asoddns 
(uonestuopuel-isenb ap sjepoul np syapour 90 JonsuNsIp 
mod ommessao9u jso « JHOIpsid » JHeoyIyenb os) sseyeo oy 
yUSWdTTONIIGeYy pud}-snos Inb JHorpeid sjapour aq ‘(Sg¢ ased 
‘T66[) UCUNOIA\ 19 UOSsUdMS ‘Tepures ‘oyduoxo Jed “TOA, 
uoneoyHeNs}sod op sassejd so] suep uoneigpuodel oun 
eB yneAInbo osvyeo Jed uoYeIOpuod xy ‘s}IsnjoxXo yUOUMOTTONyNU 
yUOS sadnois so] IS UOUIS OI9Z 39 3 OdnoIs 9] SULp jso ¥ 
puenb [= x : sooLRorpur sojqeuea sop juos 7x op soques 
-odwios soy ‘asuodel-uou ve] mod Jasi09 mod saseyeo sed 
uonelspuod op yuemoo ojdwexe un sueq ‘Wp jwouwssdold 
% ysa (¢])uonenbs| sed sguuop ssuods1 ap sjepour 
3] af~Msod uo nbsioy *Yy sod yuaprAs snjd eg] x10yd 97] 
‘O19Z MOTRA B sed vu O"Y 49 | Moyea v sed yuo u (9), / 
10 (QO)/ ‘osvuUOTHURYDE,p mod, B yUouWomd np “7 
e yoddes red x" °Y op ye99,] ap UOT|DaLI00 e] Mod gstjnn 
ySd o8e[VO I] NO UOLMIS eT e JUOWOMeQUOD ‘JUDIE | 
ap osuodar op syIqeqoid ev] op dsioAUl., yuoUopOTduT 
suse (by) f ‘aorptisa pos “7 = *x%™m “Y ‘op yuouraidoid 
asvjeo op uonenbs,| aonb aos op ‘“(b*y) f70 = mM ‘aBeyeo 
ap spiod sap uonenbs,| suep aympout jso ayo nbssoT ‘sed 
1S9,] U ‘M WSoI ve] INb onoWeIed Np mMo]eA eT sTeUT ‘anUUOS 


eSl 


JSO S]JOUUONOUOJ OULIOJ eS “SIO} XNOP o[QeALIap Jo DUOJOUOUT 
one sgsoddns jso (¢{) uonenbs,| op (-)/ Uuonouoj eT 
“suTiqeqoad op oyun] ey nod yo ‘AV 
‘gostjeor uonendod ap aire} ve] nod stoy vy] & S[QISIOAUT 4so 
‘syuepuodal op « UOT]HULYO9-sNos »> do] JURUAJUTeUN oJUOSoIdaI 
sno ‘a/*x typ S% yo “*x onb uoIsuowIp ouleW op susT| 
IN9}O9A UN 3sd 7Y “NUUOSUT SUUO]OD m9}00A UN }sd O NO 


(€1) ‘(Tus /1= 'd 

: OWIOJ op so *d onbeyo 
anb suosoddns snou ‘uyuq ‘nuuos yso ‘x 9% = *7 jonboy 
mod ‘7x ‘sorelrXne sojqeuea op UST] INd}O9A UN kB dI[OI SO 
yuUoUUI[S onbeYD ‘199.109 sd UOT}esTWIOpuRI-Isenb ap s[apour 
a] onb suosoddns snou ‘ejao nog ‘splod sao armMysuod op 
Jornonsed UsAOU UN TOI SUOYDIOYIOI SNON “UOnestwWOpuRl 
-Isenb op s[9poul 9] snos ssvuUOT[HULYSE .p uRTd ne yodde1 
Jed jUSIDAUOD HOS a8eTeO Jed moyeuINss,| onb Jo} sprod 

op squssud UN dsIINNSUOD ap sIqQISsod yUdANOS }s9 TI 
‘TEUISLIO UOT HULYD9 | op InTed ¥ IsTOYO 
wos fInb yey np yuepusdgpur yso (SolqelIVaod op ma\d0A 
un yuryoes) opuoder y yuoursja,, onb yey of 39 “’d ‘td 4s0 
yuouayutofuos yuapuodel [49 y syusUUTaTS soy onb s1[IGeqold 
ey ‘’d ‘asuodai op sytjiqeqoid oun e ‘7 s}0UEp JURUDJUTeUN 
‘TeUIsLIO UOTTHURYDI,| Sp ¥ JUOLUIgI9 onbeyo onb suosoddns 
SNON ‘uoyosiuopun.-isonb ap s{9pouul uN ,p JWsUdT[ayUassa 
y8e.S |] UOssiog op dseuUOT[HULYDE,| op seyUoW9]ddns 
aseyd onb jue} ua (aJ9]dWI0d gy1UN) 9]%}0} osuoddJ-UOU 

BI Op JUOWO}Te.y 9] SUOUTLeXE snoU “UONdes oJUOsSgud eT 

yuotpgad 

3[2poul jo UOKeSIWIOpULA-Isenb sp IEapoy| 1°9 


9]8}0} ssuods1-U0N 9 


‘OSCUUO]]NULYIIEI op sprod say mod uou stew ‘ ™m soy 
Iod Ja\stxo ossind saneiayI UOINTOS ouN Nb JaIIAg.p Issne 
sTeU “INd}eUIpIO .p sduis} np JasTUIOUOSS .p JUdUIdTNes UOU 
youtiod vjag ‘anbnewuosur ona op jyulod np jyuRssoigyUt y0F 
yso Inb 99 ‘UodSey 93390 Op synpoid soulguI-xnd yUOS a3RTeO 
op splod soy Is SUIQU VOID .p sed yUd}ISso09U OU (Z][) ON 
-enb9,, Jed stop oseuuoynueyoss1 op spiod soy] 
‘0 
<(,N/oSau) “ud puenb [(uh/1) “0+ 1] = “A 30 
(4 /.N)“O + 
(ta%m SR — Pup tote OL) (C1 ay") = 
15444 a _4(f)4, ne “1 Wo 4 _TWO 4) 


‘Juanbgsuod Jeg 


(URN) IO = "aD? 


Jo 


900Z aiqwisaseap ‘ajenbue.p senbiuyoe | 


TN) eee CIN) 
( Py ty y wna wena <)a- "4 4) 3 
diay) (fm) ay) sort x ie 


‘soolfiaA suosoddns snou 
onb sajqiey sayureyuos sap snog “10 9}eNs ev] ap /qdf.] suep 
sJUDUIN]P Pp o[quiasua | ‘(fo)¢g Jo (°S sUIUIOD Aqf Sey] UOU 
10) 0 OVS LT SUP syuawajap s|QuIOSUA,| (+71)5 IOS 

‘fo yoy 
mod %x 27% = %x “um S°7% anb oyos 9]]9) op sjurenUOS 
woos “Am soy yuomonne %([[— *w]/") =“ 
19 Jno} Np 1 seNs v] suep sed yso,u y puenb %y =" 4p “om 
ayens ve] op f qdn.| suep iso y puenb g=“» no 


sau 
icy) Crags ee ‘gee 
- 


sau eu 
ext (0) uy) Hy, Be Lig < tp | ()4 ny, —()4y, 


qUOS afi 
tod a8njo2 ap spiod say yo An SIZ = 


uyyoODl ABDUUO[YUDYIIIA 
()TVO 4) no 


Gel 


‘EURO 9) She u /[T- “uy Z=4 


> yruppyoel 
9] Jed SOURLIvA PB] OP IMdJeUINSd,] sp o[qensuNsipur yuowonb 
-no}durse yso “Sa aonb Jonuow op oyloyyip sed jso.u [J 

“PAS? O19 
ynod oseuuoT[HUeYdS.p soisap op siquiou 9] “0 ayeNS PY 
ap / qd. Suep souuoyueyss-snos syuoUNg{9 Pp a,quUdSUd | 
so '"g 30 “DO suep soguUOTMURYDS qqN.pP ce1qQuIEsUS,] 
yso “9 ‘10 oes eT SURP soguUOTTHULYDS FqN.p ciquiou 
a] 380 "lu ‘o1sop Jomuoid op Yq.p ses sun 9}0U9p %0 No 


(TT) | aan 


a7 PsPaMiessal 


wm Z| eh x 
6 


(OE) eiau 


Posy "gal 


Uy oa x 


|= 
([1— *u]/ °u) Te = 8a 
V 


: (SOTQIeT Saqno} JOS dIdOp JoTUOId Sp UOTIDIT9S Op SdITIG 
-eqoid say onbsio]) ayapour uN snos 39 UOTYSTUOpUeI snos 
sqjauidoid souuog ap juoanos ev ‘“*SSa eB [eso yUOUIO}OLNS 
sed jso.u mb 4ins mb soueLeA ev] op IMo}eUINSd,T 

‘osevUuUOTNULYSE ,| op sidop sJomUOId 
ne sosuuoysajas qdf.pP eyquissus,| 39 |§ 1 7 qdNd 
suep souUo][nURYyoS syUdUIZ[D,p s[quiosua, 4so  (1)9 
NO ‘sa[qle} soyureHuos sap snos [ (73% “'S°YQ)]%q SR 


="“4 Yuowoayeurxoidde jsa osejeo sed mojzeuryso 


onsojejeo ne ¢q@X-[00-ZI .N ‘epeuery onbysnyejis 


UN .P SJ9POu UN INS s9pUOJ DOULA VJ ‘oTUTy UONendod mod 
UOTNIOMOS v] JoJOUSI ynod UO] IS ‘sed JUSWIOQNe ste “Agn 
UW ev] Op SJUSWIZTA sap yuos / yo y puenb s9j—1I09 yUSTOS 
"3 yo 13 Jnorposd sjepour 9] suep ‘onb omoutiod op onbiSo] 
JSO [I ‘sousop ssmorsnid eB uoT[WURYdE UN,p seo od] sue 
‘S}UOUISTD NV 
"ne “(KO T=0)0 
“U op uoTTHURYDE,| AOugp “s NO 


see 
LEG ) 
| Puy iain “ — Wim | x 
z 
"934 


Ons "4-1 << (“ly ") X= nt 


Be ynporas “S84 ‘ayxayU09 JUasoid 9] SuUeC ‘oyTduMTS dOTOIJOxo 
un jso oynens ojdums omoyegje oseuuo][MUeYda snos 
MSS4 mod sonbnojdwAse sgjotidoid op yuotrassiqei9 J 

‘OJURAINS 
UOTIES PI & SUOLIOA 9] snou sUTWOD ‘asuod9i-uoU ey] nod 
JosI09 nod s9gst[WN 4so asv[vo Jed uONeIgpuod vy] onbsioy 
SOdoTJ9A a9 snd ou jyuoretmod sonbyoyduAse soyuopr 
So) ‘0 & [ed9 JuotONbHo\dusAse jso_b 10 T=(0),f =(O)S 
onbsind sonbyuapt yuowonbyoiduiAse yuos “% sop suOISIOA 
sIoq soy onb uorssoidxa oremtop 990 jueus eduos08 
OTIeJUSUTWUOD UN suep JUSUSTTNOS ee Saul b! wy), i 2 
qed sgovjduie1 yuos uonenbs op ‘pv soy no ‘(P00Z) 
ORY 19 HULUIOG SUP SOUUOP 389 dJUDIOJJIP UOISIOA su) 
‘(b/y) f'n = ‘m sed (6) uonenbs ap ‘y soy goefduros 
“‘yeor uo uO J[eputRS jo a]IAOq ‘opomse Imoy sued 

"x5 soy quedseyduier “y ooae “(¢) uonenbe,| suep oumidxe 
yuotouUOSTeI oT Ins oIndde.s adeja ororuop eT (Uu/N)“O 
+13" SV = (ujn){Q +2 NIT 4% S =a NEO Ay SZ ouop 
Tu/D40 +N ™m = NI9 %n onb sored tsure ysa ud TJ 


(6) ive pce [x L Wok] == 


yURUDJUOS 93e.S ve] op UONe[Ndod xy ‘ 
oyeS el suep soyrun 


JOAR 
(,) uonenbs | red step o8eyeo ap spiod soy soar 79 “y 
® g[eiauas uodsey op issne onbydde.s “SSa (7661) [epures 
39 O][IAOq Op xnoo ke sajeyjered syuoUNSIe sop yuRsITNN ug 
‘UOTJeSIWIOpUeI snos suUaAOUT 
onbyespenb modo ,| ap uoyeuNso.| nod snuuoom ‘!y 2% 
_Cxig °%) "x — “4 = "a sap sored ey e “SSa (oyur possnid) 
« suep yNpoUI» yso % onb yey np yoIA Wi-snyd SUID) IJ 
sel s>7 
(g) lay) 7 (St <a My) Re % — MSS, 

: olenIqse oSeuUOT[HULYOS ,p ued un snos 289 “| 
mod ui-38njd sjapow ke UOKestwWOpuRI snos suUsKOW 
onbyespenb moid.| op no soURLIvA Re] Op JIMo}eUWISO 
300 gsodoid yUO (6Q6]) UPUSIAA 19 UOSSUdMS ‘TePUTRS 


QOUBLIVA FB] Op UOHRVUINS| °*S 


@JINUSANOD Op SiNaWe SEP 19 BSUOdaJ-UOU FB] BP UO!}D909 eB} JNOd aHejeo sed uolesapuod e| ap UOHeSIIN : HOY ZSL 


ongoyejeo ne GqX-[00-ZI oN ‘epeueg onbrsneis 


‘sjedou UoU JUSUONbHeUIg)sAs JUOS sJURINSOI 
asypsquas sulyos Jed aseled ap spiod say snb suoust~nos 
‘ueydajg 30 SuIWOq] SUP JUOS 9] SoT[>a SWIWOD ‘soTeUIG 
sed juos ou *x op saquesoduioo soy Is suo design 
ane nod yney snd oyLO9p sayeIOYI UNOI eT anb 9}e)sUOD 
yUO sinojne xnoIquIOU oq] ‘JueIOI JouUOTJOdojd yuouNsnfle 
red sginoyeo (Qp6T) ueydas 30 SuMUEG Op ([qV) sosseU 
INS d3RIeO Ap Splod sap OWIOJ LI JUSWISATIOOJJO Sd vIID *[ 
no Q quos ‘74x **-: x sagjousp ‘*x ap ajuesoduios onbeyo 
ap smojea soy no ‘(b*x)dxo=(b"y)f/ so oneour] uou 
f wonouoy oun p onbneid usa yuemoo snyjd oy ayduiexo 7 

‘QOURLIVA PT] SP UONLUITSO J 
suep 9[Hn orgae,s mb gye8p oun ‘[(w/1)4Q + T]N7 
= N99 %% onb MOA op opoygip sed yso.u pI ‘ono ug 
T@sp70 +11 ZL = @/N)I0 + ENT tH SZ = tn SZ 
onb aos op ‘sojqiey soyurenuod sap snos (u/]1)40 
+ Gyo” Y+ [= (bMS QJQAQ1 019Z op IMoNe JojARL, 
op olias ua yuouroddojaasp ug ‘(b’y+]) “= NI ™ 
suep b e [esd 3sa sUUOTUOLUSNS (pP aonb suousl~nosg 
‘aspjpo ap uolonha_] Juvsin{siws ua jno] (7) uoywonba, ] 
ap ausof 0] snos aunsdxa aja juvanod spiod ap ajquiasua, p 
4gjsixa spd au jiwsdnod ]1, se MUSANOS 9s ynvJ [I Yuepusdadg 
‘so[n suly somo} e "x, 5M SX =" puenb 4 & o}QUIR,S 
uOHeIM J “(,, Dp nf bo 10 (65s jm Ss —"T) 
x x A, TRE »P"Y), J S13 + pb = (yb suope oxy uo 
“TT=4 mog (0) f7P = ,y% NO AA a S'% allp-e-}s9 9 
0 = @)b op muied jnod a ‘OANLIO UOSe} Op onua}go 
ang yuoAnos jnod (1) uorenbe| op ‘ b “uornjos our 
“JoyT[duuis mod sJaquio} 
QSSIe] SUOAR,| SNON “*Y op sJolNoNIed x1oyd 9s] JO}OUSp 
mod (NT % ams pie, snjd yo) N° %m ms omejuourgyddns 
goquiAs UN JOSITYN suOTIASp snou ‘yuepred yWOUID}OLNS 
byt 1=Cb ws 1=(0),f T= OS 
onbsind ‘aonb suojoN ‘omeoul] omowep “y= xm SY 
‘oyIp yuowoidoid a8eyeo ap uonenbs | ‘ssuuonusuisns o3eyeo 
ap spiod sap uonenb?s | & JUOWIILNUOZ ‘ddTJLIDA JOS a8eTeO 
ap uonenbs | aonb oy0s ap Isloyd js9 b 39 (Q & SONTeAD 
f ep aignuoid agauigp ef 389 (0),/) 1=(0),F T= OS 
d9AB SIOJ XNOP dqQeALIap ‘ouoJOUOW UOTOUOJ oUN yso / NO 


(L) Gu ty) {tp — NED 4% 


® (9) uonenb9 | sed sguu0p 
asv[eo op splod sap oleoUl] OULIOJ ve] JOsI[eJoUSs suOANOod 


snou “(766 1) [ePUIRS 19 O|[IASq Op segpr Sep ueyed ug 


IAIVIUT] UOU JUIWIITJONJUIAD ISEIVD «“p 


LSL 


"« SOTRJUDWUNSUI SoTQULIVA » 9p WOU 9] 7X ap soyURsoduos 
sop soulesul] suosteurquiod sop sed juos ou inb *y 
op soquesodwiod xne suouuOp snou ‘onbiysuIOU0D9 ST109q} 
eR] op juemdsur snou uq ‘aseyeo sed uonesspuod op suULIoy 
dUN “dI]VOI Ud ‘JSd [PUPILS 19 OBADISA,.P I[[OUUOTOUOF SUTIOJ 
B ase[eo a] onb UOI}UTJSp a[[aAnoU aHOU Op dNOdEp I] 

‘OINLIDANOS ap SANI.LIO sop 
no osuodsl-uou ve] dp UOT}D91I09 v] Inod osvyes np sO] oy 
YO} VIDIDAR Ss oseTeO Ied UOneIOpuOd ke] Op sIdIe[9 UOTTUTJOp 
on09 ‘suoJOsT]yN snou onb ayja0 4sd UoNTUYSp sa09 


‘So[qrey sayuTeUOD sap snosyso,j 7 “7 puenb 
uonestuopuel snos juasioauoo ylos mS T= TW |] oo 


99 
{> |x} mod o8eyeo op uoyenbg | yuossejsnes *™ soy 1 


aonb ja} ‘{¢ > ¥|*m} ‘spiod op ajquiasua un : o8eeo 

op spiod sop osuRvyool op UOTUTEp oun sIOdSNS PIID 
"> 4 noi mod Q=({9>3 3/77} ‘{933|"4y °x}|"3)7 
puenb (7) uonenbs,| red suuop omeouly ynoIpeid sjapou 
9] SNos sterg sues so [J ‘189,, 7 “7 puenb uonesmmopuer snos 
qussroauoa yso ty" SZ ('x! yo SZ)(x'v SZ — *7) 
+ WD SZ = WM SZ = WO G ‘sooluigA suosoddns snou 
anb sajqiey sajutequoo sap snos ‘anno uq «(‘x'» SZ — *z) 

LC xa’ S%)]=b onb moa op opogyip sed sou [] 
x7) JuoUIoaOaTJo sovjduar “Y no “(~) op oy qrey 
uonesyeioues oun 3so (9) uoTyenbs,J ‘UOoIsUdUNIp sUOUT 
OP SUUO]OD M9}99A UN 4sd b 49 ‘ayqisioaut yso *x"y"y SZ onb 
Ja) ‘*x onb uolsuswIp SUIOU op oUSTT M9}090A UN yso *Y NO 


(9) ‘(by +) "9 = 
: JULAINS « S]JOUUONIUOJ SULIOJ » BP] MOAR Pp 39 BeTeO 
op uonenbs | oiejsyes op sasijqo JuaWATNES JUDIOS “M soy 
aonb gsodoid yuswayJonUasss yO si ‘oovyd ey YW ‘s0URISIP Op 
UOTNOUOJ OUN JUOSILUTUTL OSeIed ap splod soy aonb JOUISIXO | 
Jouranys,p osodoid yuo (7007) Jepures 30 OvAdsq 
‘uones 
-IWWOpueI SNOS JUSSIOAUOD yUOUUOTToNIIQey 30 (7) UONeNbE | 
Jed 9QUUOp d[9pOU a] SNOSs sTeIq suRS SIO} eT ke RID 
aActy SZ = TW | ‘o8ejeo red moyeumnsa,] ‘uonbesuos seg 
‘ase[eo op uoNenbs | yUosseysyes sjt.nb oyuleHUOd x] snos 
“Ip soy “xneUIsLIo oseuUOTTHURYDE ,p sptod say jo o[quIOsUd | 
Op SOIQUIOU So] dNUd dOURISIP Op UONOUOJ sUTeLIDD OUN 
yuostunmun = ‘{g > y¥|"m} ‘aseyeo op sprod sap sjquiasud.] 
aonb uonIpuos sum0d yuoresod (7661) [epuseS 39 aI[IAOq 
‘asvjed op splod sop o[eulsuo0 uOnIUIOp moj sueq 


35¥[vd op spiod sop uonIUyIpIy “¢ 


9002 auqwesep ‘aj}enbue,p senbiuyoe | 


"INOJCUISS 399 op ouUdAOU 
onbyeipenb mous] e JHeoyUsIs uou yUoWONbNno}dwiAse 
IgnqLyuOD uN jyWoUWTATTENIGQeY 389 OHAYH Moyeurysd,] 
op uonestwopuel snos sieiq a] onb amyjouod suoAnod 
snou ‘souvleA + sieiq=ouuesour onbyespenb moto] 
onbsing ‘U/] oJp1O Pp JUOS UOHRSTUOpUeI Op SUOHIPUOD Sd] 
suep HAYH INoyeuyso,, op sayejos suushow! onbyespenb 
MOLI] 19 JHEIeA steiq 9] ‘ayno ug 0 =[N/(Z- °° “D)] 

“wd jp yuousyNe ‘uOyesTUOpURI snos jUddIBAUOS 
SO OFTYD Inavuryso | onb MOA op gste yURUDJUTeU 489 I] 


n>4 S27 


(S) ‘(ujn)10 + *a { — tat = 


934 937 $24 937 
FOTSE SDRC GUIS POUT on So CO lle Fo tog he 
| ow 


ouLioy ej snos 97% “7 ap mound] 
outdxs suoanod snon “(UufS/N)“4O = 72 1x "0 "DSK 
9 ‘Q=a/x'02% onb syos op “'ix’0.2%_('xix’o 2%) 
1x ~ 14 = "a HOS aA om xX Ollo ed “= TO 
(UN/N)7O = *¥/X!0 OX — "yixto"0 SX “(uf/N)70 
Eph ih ois oy sz ‘(emoyegye ang ynad ayfogs ote} el) § ep 
onagad ay]te Bf so uno (ud) N)70 = “L-7 “7 aonb Jaq 380 
aseuuo][nueyss .p ueyd oy onb 30 (Ipuoyoidde snyd yuoursyre.y 
un mod epogz yoy ‘oyduroxo red ‘MOA) SadflI9A yUSTOS 
SO[QVUUOSIeI dILIv[NSOI 9p SUOTIPUOD sap onb suosoddngs 
‘Tx b= b’x onbsind ‘ouuojoo 


(x0 83 — “DL, (xix'o' SZ] =b no 
(r) (bYx'2 +p) = %m 


SULIOF BI SNOs soutIdxe o9 JUdANod ase[eo 
ap sptod say onb suoasjasqg ‘Joyl{dunts mod uonrjou ev] suep 
ejao suoumtiddns snou steu ‘’p"2 sap jo ‘9 ‘asteol uOTTN 
-UeYO9,| 9p SUONOUOJ sop yuos “M say JuepIed yUOUID}OLNS 


gal sel 
Ayn Ix! xp! Bett ae Yn — 4 
x*pi0 Xoo K ero Cao 
j ee 


no 
Cty SZ = CTI “7 qBId OUTLIOD OBERT Op OUIOJ OUN snos 
y1I099I1 o@ nod (¢) uoNenbs,| ap HAYHO Moyeurnsa,T 
‘smo[no} 4sd | d]J9 nb suosasoddns 
snou ‘a}Ipoumtuod ap ronos Jeg ‘onbryeid ua o]qIsIOAUT yUOUIS 
-joniqey vlos *x'x"p "2 8% onb ayrusis uoNIpuod oJQTUIOp 
sned 2 Op ayrey ve] isa NV no ‘oAnIsod susp soLneu 


mojo0A UN 4sa 


onsdojeyeo ne Gq@X-100-Z1 .N ‘epeueg onbysneis 


oul so) Von x x70 8S "yy “4X: op: WonsOy 
oun 049 UOU no jnod nb oneHIqse QuR\sUOd sun yso *9 NO 


S27 3 >) 
(€) Ix Ap Phase Nl gery 
dpe aks Cake Hi iki ket ede lhe io Kes all 
ie 


7 ; 
tf Dat 


: MIO} BT & HAYD No sgsiyeisuss 
UOISSOISOI RI Jed MoyeuNsd.| ‘opnjd sou op su xny 
‘(SOOUTULLIAJapaId SoJUR]SUOS Sop SUID 
1] sap 30) samoyegye sopqeliea sop ourut0o 73 sop yuotUaIEN 
he sousIg}a1 Wey 3 Sompury ‘(UonKjou ey Joyrfdurts mod 
juoUaUUONIpuCD 9] Jueuddns us) g=(“z— 7° “7)*9 
aonb suos 90 ua g9pou a snos “7 op_ sieig 
sues moyeurnss un ysa 7Y9 “7 aonb MOA ap oIOR] 489 [] 
‘ajapoul un Ans apuof 
(Jnopeid) sspeo np ‘oyqeuuostelsp stoyred yo ‘onbyLI9 yoadse 
UN P 1188,S |] ‘oseUUOT[NHULYDS Pp SWISTURISU 9] JoOUSI ynod 
uo, onb suosoddns snou ‘*7 say ns souvsedse 9)399 JuRUUON 
-Ipuod uq “Q>¥ yno} mod g= ({92 877 xi 143) no 
) a4 gx = 
: oure9ul] JHoIpesd 
Q[PPOUL J] JUSISHRS SaMOJegTe So[qelIVA sap sumUIOD 7 say 
Joey & dISISUOD dsvUUOTTHULYDE | op sydoidde anne sup) 
‘oyJod ap 
uonouo} oun osiuunu {9 > y¥|"} yo ({) uonenbs,] yuestEy 
-syes ‘{9 > y¥|"} ‘spiod op sjquiesua.; anua soudIOTIp 
e] onb uontpuos sumo ssodum yuo [epules jo d]]IAoq 
Saw 
(1) OL= xm << 
: asnjvo ap uoyonbha J yuoysnes tnb 
{5 > ¥|"m} solquissua .p UINNUTUOS UN JUOUTATe.IDUSS 9\STXO 
[Lnbsing ‘nuuos 3so “7 jenbnp jolns ne “(x ‘+: <x) 
= "x ‘somelrxne sojqeiieA op ous] Imo}ooA uUTeyIOD UN 
mod *;7=*x9%= %xmSZ no WMS T= |] ou} 
R] Op IMoyeuNso uN sMID9p mod « aseyeo Jed Imo9yevUIT}sa » 
UOISSsoIdxa | QUSAUI JO (7G6I) JepuRS 390 JIANG 
"'y JUOWUY]D | 9p aspuuojpyjuvyra, p splod 
gy 3so Yus*7=% no MDS Z = MD Z=41 Y ome 
yuoweyes9 sUOANOd snoN ‘uoYwsiWOpUDA DB] Ans saapuof 
SoJIP JOS soIOyeg[e So[qeUeA sop SUIWOD sog}IeN JUOS 
1 soy onb yey np yuatnosep nb sajgudosd soy “7 ap seq 
sues mnoyeumse un yso 7 “7 onb OA op oIIOR] 189 JI ‘SOIIO} 
-eg[e Sojqeiuiea sop oumuos *7 soy juRyeN ug ‘UoWONNe 
039 §S>¥ puenb T="7 no Mus "7d OX = Mu 4 SK 
=7 “7 yorsuayxe,p mmojory ev mojeuNsa,, op udcou 
ne ‘onendod ry ajousp Q no “4 = “7 ‘uonejndod 
Op [e}O} NO} Jose suoAnod snoN “¢ UOT[MURYD9,] SUBp 
y¥ oseuuo][HUeYyE.,p jJuowsTa onbeyo mod ‘"u ‘uonosy9s 
ap oyiqegoid ey] suorssteuuod snou onb suosoddng 


AND Ansyeuryse | 39 ssvyes avd uoynesgpuog °7 


SINUOANOD Op SiNBa SEP je BSUOdaJ-UOU e| 9p UO!}DEI09 eB] INOd abejeo Jed uoleJspuod e| Ap uO!}eSIINA : YOY OSL 


“AOS epsn’sseuMnoyd : JouuMoD ‘stup-sierq “OCOTT WA “xepuley ‘AemYSIH{ 297] PIO ISTE “POIAJOS soNsHES [eINy[NOTIBY [eUOTeN ‘NOY “s dy“ 


‘OIAINSINO 9s JUDATOP SYOJOYOOI op xneAey soy sjonbsoy 
SUP SOUTRUIOp sap 39 sayooidde sasidAIp Sop UOTSsNostp oun 
suojuassid snou “6 uoKoes eT eB ‘UU ‘apruyyor! neoAnou 
a] yueAndde onbindurea ayduiaxo yyod un suouuOp snou 
‘2 UOTJONS B] YW “OSEPUOS dp aseq PI SUP JUSUOIQUIOUSP.MS 9] 
NO -snos 9] OmIp-B-189, ‘QINJIIANOD Op SMOLI9 soy Inod uoyes 
-wopueiisenb ap sajapoul sop suondsIp snou ‘/ UOTDesS 
eR] VY ‘sonbyuspr yuowonbyojdwiAse ono yUOWOTessoooU 
snyd yuoatop ou oseyeo sed uoyeiopuod ev] op soyjouuonouoy 
SOULIOJ SOSIOAIP Sd] ‘a}X9JU0D 90 suRq ‘esUOddI-UOU ke] Op 
UOT}dA1I09 BI INOd sasiTyN ang nod o8ejeo sed uoNeIspuod vj 
JUSWIUIOD SUOALIOSp snou ‘9 UOTOES BI YW ‘aseUUOTTHULYDI .p 
suryjd suteyioo mod opmypyorl neoanou un suosodo.d 
yo ‘ouussour onbyeipenb moo]. op no souRLIeA ke] op 
UONCUNNSA | ONASI Ud suOSsed snou ‘¢ UOT)ES Be] Y ‘SoTeyUOUT 
“NSUT soyqeuea op gyifiqissod ey emyour.p uye ‘[epules 
9 O]IAoq op oseyieo sed uoneispuod ke] op jyuoWIEN 
9] SUOPUd}9 snouU ‘Pp UOTES Bk] Y ‘SoTeJUSUIMSUI soTqeLeA 
Sop oMpOUL.p Ue ‘oMeoUT] SuLIOJ es suKP ((QDZ) [ePUIRS 
JO OvAD}SA.p ose[eo Jed uoneIopuod eI op UOTISUd}xO,] 
SUOALIDOp snou ‘¢uUOT}OOS eB] Y “Nd sseUUOTTHULYDS.p 
9}xo]U09 UN sueP HAYO moyeunsa | op Jornonied seo 9] 
onAdI us suossed snou ‘7 UOT}DES BT B ‘oseTeO Jed UOTeIapuod 
op onuuod udIq uonOoU x op UONRUSoId ev] sody 

‘JUSUIIATVIO SOUTUUIO}Op 9.9 JUSssind syip yusussdo3d 
asejeo op spiod soy onbionb ‘adejo oun ua sgnoyeo oseu 
-UOT]HULYOS9I Op spiod op uoHesTNN | ms osodal |] ‘Tepures 
-JIA9q op uonesueouy ied soueLIeA ke] Op moaeUINsd,] 
B ondsoyeue jso Inb oymmyyoel neaanou un suosodoid snoN 


Tepures 
32 WONspun] suep stwuod juowaesa jsa mb 90 ‘oseyeo 


Op soyqeleA sop JoIgJJIp yUoANod uoTesTMOpuRI-Isenb op 
J[Qpoul Np soayeoydxs sapqeuea soy ‘oyNo u_ ‘sed xnap soy 
suep sgjolidoid soy 1o1 suouTUexa snoU ‘simayne xnap S30 B 
JUDD NV.HUOS ‘STOJaINO[, “YSUTS 39 WOs]O 9p UOTesTUOpueI 
-Isenb ap d]apoul o] 30 AdeTVd 9] JWOUdTJonIIQey puUd}-snos 
Inb JHoIpeid s[Ipour 9] 9.QUd UOTJOUNSIP ouUN sUOSTe} SNON 
(6661) [epuuRs Jo WIQNspuNT Issne MOA *(/661) xe 
30 UlYSNOT “Jo[N.J suep saxnsuod ayo ynod s]v}0} asuoda1 
-uou ey mod juawasnie, mod series sed uoneigpuod 
Rl op ‘oMeoUl] JUOUOJOINS ‘OMOLIQUe UOISIOA OU) ‘“ISIRIS 
9}xXO}U09 99 SUPP UOTesSIWOpuUI snos suUdAOUT onbyeipenb 
IND] SP NO JOULLIVA RI IP UONLUINSD,] JOST[SPOU Op onA 
Ud [epuIRS-d]][IANQq ep oyooidde | op amessao9u UOneOTIpOU 
oun siiduioos A ‘YsuIg jo WOs|oO. suep soltqnd syeynsor 
xnediouud sop uonnedes oun 4so aponse yuosoid np m9 aT 
‘OINJD9] OP SITIOS 9dAe ONADI OUNONe suKp satTqnd 939 yuo .U 
XNBAR Sd ‘UONesuopurl-isenb ap sodoidde sayapou 
Sap SNOs 9]e}0} osuUOddI-UOU PI (NO) 39 SINJIBANOD op sonuUOS 
SINDLID Sd] JOsIIOD mod sgstjHN ayo Issne ynod asvyeo sed 
uoneispuod ey onb snuoul yuo (Q0QZ) YsUIS }9 WoOsloJ 
‘(OTUD) 
dasl[e1ouss UOISSoIsol eI Jed mMoeUINSd,| Op JULIO; 
a] snos sed sanoy os ou nb “(siejsue usa ,Suryel,, ‘TqV) 
JHeIgI pouuonsodo.id yuourssn{v | sajadde issne yuononb np 
SANLIOT Spoyow vy onb soajja} ‘Uonergpuodal ap soyuemod 
sopoyjowul sop uorIsudyoidwiod anou yUoWApULIS JOssoId 
-ol1d yey e mb 90 ‘oseuUOT[WUeYDS,| Op 3}xa}U0D a] SURp 
sonbyuapr yuouronbnojyduiAse yuos oseyeo sed uonesopuod 
Op SOUJOJ sasnoiquiou op onb ayUOWsp jUO (7661) [epueS 
JO O]JIAOG ‘WoOHestuopuel snos d9UdBIDAUO0D Pv] JURUDIUTeU 
Ud SSBUUOT[HULYDI,P SINDLO So] SIINPEl op ona ud yedap ne 
quiod ne astwi 939 & ase[ed Jed UONeIapUOd op spoyjoW eT 


uononpo.nuy “| 


‘gstpeigugs (Sunyel) Jed} jouUoNJOdold yuowajsnle ‘oyeyuoUNsUI 


g[qeiieA ‘uoTestwopuRs-Isenb snos jUdsIOAU0D ‘uOTesTWOpURI-Isenb op sjapow YyoIpsid syopoyy 


: SQTD SJO[ 


‘SOULLIVA BI IP UONUIT}SO.| SUBP VON} Pp UlOSAQ 9] JOUTUTTD .p youLIod ofruypyoe! np oyUeLIVA oUN “aTIesUT] 
uoU SUWIOJ oUN e oseRIRO Jed JUoUo\sn{e,] Ig ‘odeTeO op IM9}99A d] SULP sosLIdUIOD saT[90 ap sayUsJayJIp sonbysugjoesres 
ap s[quIssud UN.p UONOUOJ 9UN jos (sUOSIP) osuodgJ-UOU ev] onb youLIod aseyeo Jed uoNeIspuod x] suep soyeyuoWMNsUT 
Sg]qeLeA op UONONPOHUL,T “o19TURUT 91199 Op sesI[yN yWOS s[Inbsso] JosIOAIp yUoAnod snd oseuUOTHURYDE Pp 9}xO}U09 
un suep sonbnuspr yuowonbyojduidse Juos mnb oseyeo Jed syuswiajsn{e sioalq ‘UoNestuopurl-Isenb op soudoidde sojepour 
SOP SNOS dINIIANOD ap SIMdLA saz (NO) 39 9]e}0} ssuod9I-uOU eT JOBLUOD mod sasi{WN ang nod aseyeo Jed uoNeIgpuod ey] 


SuINSoYy 


(HoM *S dd 


91N}1IANOD OP S.1NI.1.19 Sap 33 ssuod9.1-uOU 
Bl 8p U0NI91109 BT Anod ase[vd Avd UOHvAIpUOd EF] Op UOHLSITD] 


6vl 


anbojeyeo ne GdX-L00-Z) .N ‘epeued anbijsije}s 
O9L-6rL “dd ‘Z .N ‘ZE IO 
900Z eiquwiad—ep ‘ajeanbua.p sanbiuyoo | 


"EY 
POUT Aes 


saiees wn a 
La 


iene: » ® Soeur oi die 
2 QO, 2 on 
is oamacs 


=> Ag ms Pane UHhigi?) er 


mae MERE Tall ial 


* beartr? 


anoags Mi eee pi joe 
™H 1 raat Ee ay STS ae Ee Me F 

a anioeg MH, MED Y RPG eae ox ry 
pecaseuraa 1 ene ay Kd Poage Ao baRe 


oT 


< s 14 ¥ 


emer ae the PR 
er peers: ny We cotegear ca tejennse! 


sabi fi qawnons ‘ee iain Hes 


= ™ Mine cae Ge Nisa Prise 


7. ny tne? Kroes) a, sce aagreye prio me 

PARR uy wie 2 hea ebs Pa 4 ey “Ee % rE we pe Sa a: 
eapppaeeh" Re ers eT 7 aay ‘wt, =. 
eta tP rahe WR, Cosi " ae tye gory AMR? ~4 


Bee 7 ere a) Tang ip y' AR. 0 ne Af? ei 
my eR an yess pean 
rae: Past va nt Tih pag 
ee ene ‘a! Sect ou: Ke st 
’ “a py’ iy (ny7G SOF noe Le ao (a 
ig D eotepeant ee Y (38) pmete HK HNjpAss Gt tho 
SST Ur) (Gg A Hs ritad a 7 
nh esl patat so Avwe MAR AM ty, ) aes ay ‘og 
urls iF © (ang he Se aie itoriten te 
sy nba tin ‘Sry neared: ; &% 
hy aaancee (ear cw se Lea} 
Been” AE AD0by ae bg | De 
ANGH TOL ee CL NAL QAR Lua Bt 17 
Fpetpee’ WE (1Aaey AOAC! Wy GergetorO 
Ngee EPS (sary: tl 
4 Amp arin owank we — ree 
BUR AN MAGA) AY PON 
ade asin gti Jao alll lemme pode Hk i 
BR 8 AAA MIRE RAPHE 
S200D) sits 


‘ o A , ar a) ee } 
te aR. Someday ar ae Lins a re Staeuse d ae 
one. ieee alan a PO?) MURA: 


p¥K 


fu. Act 
PNA amt 


ay “iter al” | 4-98 


Le hs as 
esmaest wectiop Hip pe. 
BRENNA S ORR 


| gt ing Bad. DIB, 
For 


weyaar) Bleteed a 
np, "de Ws BOO 
Ps ¥: vith dei 


. CRAIC ey ery a deast 


: i 7 roa Py Ai 
wy way: — * » i" iM . P 
i sae ey, 


La ij 


tse toneay39 sisladetan tg 
er cn 
‘otek oat es enn 2h 
nyt Aneel 3 eee 


ee er pian 


au he 


fea 


Nt YET saedan oe 
ak bh =e \) 9%: ae 
BK Bee, Old rae 


TMM ete J facet) wt) 


typ sare She? que wy _ a Riad Top 
i | | Peg OL RA ag, 
eet a pH i Lew hy hee. 
~ hie ay ~ war " Sie +. FE) 


uae weirs ey wrth) ey ari ‘ Sead , 


chat haan SEU. LARTER NR. SINE 
ls x Lf ah : HIPS ke a LTH: na Pp | 
ny? nf Jy aT ty b) 7) 


' sin 


rt 


- sretatty nope ssaietchiah x ww ayy 

Carries iy Boh uy CEU aE ohipe quays! va a bur t) cis a 
“ shytor hey aK ‘Patel at bie hye, Wee) may GP ae fie 
oe sages ie | ang erty aie at RtAl Ras San ager (a OA 


va ne OS 3% at BR j \ vu ia ar '" 


ue - a3 Auth] & tee Me! + : 
eK i a i a: SP OGY “ar Cv, Tyke steer st 
pra’ 4 ft Hit 4) Teper Sialic LARP Ss 
yr iewae Sir weer . alae a aie. x 
: hod SPURT: INGEN Seah Gh, Dae | Goll “ft “U4 
“ph ae hone nye au thd rN 

i ioe) bt r w © oT AiO, ee tae 

ict eh yrs n ill 

Be ae enone! LN RR ar ey ty 
ee pt ik Mattie ae Gis apap eee a 


, ayvinr’ ¥ 4 ' i ap, ? 4 

aan le cat ae : 1.4 
> SLRS (eel akg ECs niin 
Vie nile ZOO rhatitie CHAS OR) ae eile 


i ae ‘ 


inwiehant 4¢ aks Li dha PaNIHIG? pl 4) 
eae i et SIP SAR ct Fp wey: 
>. ee EL (i bd ul 4 on » rt ‘ AM Me 
fbgion — os ben LEW at ae, niche Weed, is 
peeper § i q 1,730” bi NAb Tare Rie oe “y wae AD : ye 


. sala pots yoni OL alii MEI TESA ae wot 

DEPRES AS ALO AR PRG), ls PE 
Phe PL eye & sig FLiyM 
[Neer 


ey neha aoe GS 
Se CRUST ANE ag Se ie 
CEPR Cae ONTE te GE (tats 


‘masitieys ih" Ae al fo Wevieed nb = Vik 
PRAY TARP ok jy ie: ert ey eee 
‘Ot SRS (SP BIS? Sew! asia |). ANT ae 

: ‘yep ans ey aia: Ui Shae 
Uinamerereen iy wey ieee ars Ry praue id 


Pyahiecer 1c fp cif CPV at beater teed, 


Sey 


angojyejyeo ne Gq@X-100-ZI N ‘epeued onbysnejs 


"E618 “Srl 
‘Asojonuapidy fo JDUANOL UDILAAWP “S[OIUOD pue eUWIOT[S YIM 
sy[npe Suowe suoyIpUuoCd UAa}sAS sNOAIOU puUe Ja0URD Jo AIOjSTY 
Jeorpow jeuossod pur jermuey (L661) ‘if ‘sneyNON 39 ‘f ‘OYOUST AA, 
‘YT ‘slaeq “D “Iosreg “g “UeULMON “YY SON “WL “O07 “WW “YOsuoI AA 


“T89E-SLIE “OUT “SUOS 7 ABTIM UYOL : HOA MON ‘(UOIOD “L 
jo oseyULIYy'g ‘spq) ‘sousynjsoig fo pipadojadouq sueq ‘sorprys 
jomuod-aseo Joy Surjdures Surjerp u3ip wopuey (R661) ‘f ‘B1EqQSIeA\ 


‘OOP ‘EL ‘UOUDIDOSSP JDINSIIDIS UDIIIAUP ayy JO [oUANOL 
‘SuleIp ySIp Wopues Joy spoyjour Surjdureg (3/61) “f Broqsye 


‘SZOI-6101 ‘SET “Asojonuapidy fo jpusnor uvdiueup 
‘So[CIOULIg ‘[ ‘SOIPNys [O.WUOI-ased UT SJONUOS JO UONDIJIS (1661) 


‘Sf Jopueyy 10 \['q “ueuMATIC “rg “UNTYSNeTOYY “Ss “opjoyor A, 


‘Ot 
“LOT “b9 “A “Mats0g poousynig podoy ay) fo joudnor ‘pooyrfeyt| 
uunurxeut Aq eyep JONUo-ased 0} Jopoul Buy JOF spoyjou 


payyiom Jo ssaujsngor at UQ (ZOOZ) ‘f'D ‘PIM 3° “fv ‘Hoos 


"LT-€ ‘96 ‘aouadafuy puv Buiuunjd 
jpousns fo pouinor “pooyrfeyy] uanuurxeur 4q eyep JONES 


-9Se9 0} Sjapour uorssaiSar SUNILY “(QIO0Z) ‘f'O ‘PIM ¥ “LV ‘Hoos 


TL-LS “OS ‘sousunig payddy ‘sorpnys Jo.yu0S 
-9Sed porojsnjo Jo siskyeue oy (®TOOZ) fO “PIE 1° “LV “Hoos 


TL-LS “€8 “DyLMowolg ‘pooyrfayy] wNuuTxeur Aq eyep Jo.UOD 
-OSED 0} S[OPOU UOIsso‘se1 SUIT (L661) LD “PIM 2 “fy “Hoos 


‘T8I-OLI “8h “a “Gars0g 
jooysyojs podoy ayy fo jouanor ‘surjdures paseg-ao10yp 10 Jo.UOS 
-9SP9 JOPUN S[opoll SNsIso] SUNT (9861) ‘f'D PIAA 19 “LV hoog 


‘OLOT-6S01 ‘8 ‘vaImig voysyDIS “eyep KOAINS 
UPI $}S9} BJOOS-ISENd “(866]) ‘['D “JOUUPYS 19 [VY Hoos “WN'f ‘ory 


E€T-STI ‘09 ‘DyLuaworg “sKevms [eonsyeue 
pue uoneoyyens Joy Suydures sqnop uQ (€L61) “Nf ‘Ora 


‘assaid snos ‘79 
‘soajauorg “eyep ATT] SAT}OOdSO.NOI JO sisAyeue ay} 0} soyovoidde 
oytoods-Ajrumey (9007) £O ‘PIAA 1° ‘TV Hoos “f ‘sneynoy 


“LE-€T “68 “Dyluawmorg ‘soIpmys ApTuey sATOOdsoNOI 
Jo siskjeue oy, (Z00Z) 1D PIM 1 LTV ‘Hoos “f ‘sneynon 


‘LIP £0 “99 ‘vylyawuolg “soIpnys [O.QU0d-aseo pue 
S[OPOU SOUDPIOUT asvasIp ONSIBZOT (6161) “YU ‘Ad 19 “TY ‘sonuslg 


‘OSOI-ZPOT “SET “Sojo1mapidy fo pousnor uvriauypy ‘sjoolqns 
Jo uoNogjas pyeA :Apms JoNUOS-aseo oY (S861) “S'E “UOUTOIP 


‘OUT ‘suOg 2 ATTA, UYOL 
:IOX MON ‘suoywoyddpy MAjaumouody ym wvjoq ajasosigZ 


fo sishjoup joAmIn-As (1861) (SPA) “CA “VappePW 9 “AD “Pysuey 


‘(omrered VY) 66 ‘pylyauorg ‘sojdures poyuswsne-aseo YIIM S[apoul 
uolssaidar AremIq SUNT “(900Z) “f'D “PIM 19 “TV “Hoos “py “oT 


"SE-C1 Pp ‘19 “q ‘ja1209 pooysywjs podoy ayy fo joUANOL “UOISS2IB91 
UI swo[goid eyep SuIsstu pue dAde]JAS-asuOdsa1 JO} spoyjoUt 
oujourerediutss “(6661) ‘f'O ‘PEA 3° 'C'f ‘Ysopqrey “A's ‘ssopmey 


Lvl 


“OUT “SUOg 2 ABTIA\ UYOL : YIOX 
MAN ‘sdaaing ys[vay fo sisAouy “(666 1) Ta ‘Preqneip yo “Tq “Woy 


OS-7S “HL “YNPAH 19" 
fo joudnor updidaup “APs MOIAIOJUT JO.UOD-dsed JO}Ud0-Ny_ NU 
& Ul spoyjour pue UsIseq] (p861) NY “JOAOoH 39 “q “URULIOATIS 
“qd “unsny “W ney “sem “Tf “TRO “W"T “uoqlg “dq “suey 


‘€€8-S78 “OCI “Asojoiwapidy 
fo  joudnoe updiewp ‘dnois jonuod  paseq-uonejndod 
& SuNogjes Ul SulyeIp jSIp wWopury (pPR6I) ‘f “BsoqgsyeA, 
19 N'Y “OAooH “Tf “TWYED “AL ‘Teyjasoy “yy ‘uojuLg “gq ‘edyeH 


“ILOI-ESOI ‘Sp ‘songaworg ‘Surjduures joU0S 
-9sed poseqg-uoneindod ur sisAyjeue orsojonuopida uo surjdures 


JaysnJo JO spay (6861) HW ‘TWeD 1° WL ‘Sleog “Tq ‘preqneiy 


"861-061 ‘96 ‘SaLuawmolg “I20ued Uys eUOURTOUTUOU 
0} uoneolyddy :sjomuos Jo Surjdures sJojsnjo yIM Apnjs jo.UOS 
-98e0 oS8vIS-OM) B JO sIsSATeUY (N00Z) HW Ted 1° “UWL ‘sieey 


'096-SS6 ‘TH ‘Salajawmiolg ‘sainpscoid 
suydures xojdwos Ssulsn soipms jomUod-ssed sanoadsonal 
JO} S[SPOUI UOISSOISOI ONSISOT “(986T) ‘O'O UMOIg 10 “YL ‘sieay 


‘SLL-ILL ‘SSI “A8ojoiwapidgy 
fO [DUANOL, UDILAAUP “SIIPNYS [OIUOS-dsed JO} USISOp o]duues ve Jo 


yUoUUdO]OAOp oY} UI S]jo-opelL (ZOOTZ) ‘f “Br9qsyeA 39 “YY ‘ourjoeHIGg 


‘OIEI-687ZI ‘6p ‘Valajaulouoarq ‘soydures poseq 
-2o10Y JOY UOHLUIsSe pooylfoy] uNUUIXeY] (1861) “A'S “Helssop 


“LUII-6ITI “EST “ojonuapidy Jo pousnor upoideuyp 
‘OSVIDAOD PfOYSsnoy-uIIM pue soyel osuodsay :surjdues vase 
pue surjduies suoydoya} Jo uosuieduiog ([Q0Z) ‘WT ‘uolLg 19 


PU ‘sawon “Mg B8epq CWE BIT “WW ‘Borstuuag “fq “uesoIg 


‘T9t-Lrb “6S “a “Mlat00g9 
jooysybpjg podoy ays fo pousnor “Surjduies yuapuodap-au0s9j;no 
aseyd-om} Jopun siojowresed uorssaisal oNsiso] Jo uoneuUmMse 
pooyroyy] wmnuxeyy (L661) “AU “AOYQN|OH 1 “AN ‘Moysorg 


89r-LSb ‘8b ‘SousuDg parddy ‘sisousord 
JowN suIA, 0} pordde suiosjno Azeulq YIM soipms oseyd 
-OM} JO sisATeue pure UsISOq (6661) ‘N ‘oofaneyD 10 “AN ‘MOSoIg 


‘OCI ‘SL ‘vyluawmorg “eyep [O.UOI-dsed 
a3e}S-OM} JO} UOISSaISAI INSIST *($861) ‘OTA “WED 10 “AN “Mopsarg 


“61 €-L87 Jesuudg 

:IOK MON ‘OMG ] 10 sSuUIOyY'M ‘spq) ‘Asojomuapidz 
fo yoogpunzy sueq ‘soipmys jonuos-ssey “(P00Z) “AN ‘MOTSOIg 

'87-Pl ‘16 ‘UOlDIDOSSP [DIISIDIG UbILMaULPp ayy fo jousnor ‘Apnys 
Jonuos-ssed oy :Adojoruapids ut sonsneis (9661) “A'N ‘MO[Sog 


‘C6C-6LT ‘TS ‘anbusuyvig 
ap ajbouoypusajuy andaay “SKoamns xoejdwi0o Woy sioyeuryjsa 
euuiou AyeonojdurAse Jo soourweaA oy) UO (E861) Wa “Jopulg 


066-€86 “61 ‘eUudnor aspasiq snoydafuy AajoIpad “USIp| Tyo 
pueppny Ul asvasip esoo0SuUTUDT OTUDpIdd JO} JOJORJ YSU Jofeu 
V :sUIpMoId pjoyasnox] (Q00Z) ‘qd ‘WouusT jo “A “UlaysIOqoy 
“pf Saemaig “N ‘souor “N ‘youReyn “y ‘sejousINOW “We “oye” 


ary dvasorqrd 


900Z aiqwsc—ap ‘ajenbus,p senbiuyoe | 


‘sjonbusd .p ssguuop sap dsATeuR | INs OARS UOUT NO} 
JUIWIdT[a1IWUNSsS9 stop of jonbne ‘ovey Uor 4d ‘opOVIe JUasoId 
9] JUNpUd}-snos nb xneAvI} soy sno} onbsaid sagstyear1 939 
UO Jonbg] ddae *PILAA SUD aep onsuo] op sim9je1o0gey][oo 
soul juouayeloods yno} Jolosouor sieiowief ‘uyuq 
‘jolns np uortsusysidur0d eu JUDD GQVIOpIsUOD JassoIs0Id 
YR] v aoe JUSSOId Np dINdII9JUL UOISIOA 9UN .P dIYDITJoI 
UOISSNOSIP ek] JOP ‘UOYey WeyPIH jo preqneiy Aueg 
onb Isute ‘sinoyeuruexd soy JoIoIoWIOI eB suo of 


SJUIWIIIN 19 WO YY 


‘sua[GO.d 99 Op UONNOSAI PT B SADVOTJO ASepuUOS 
ap suvyd soy ns saouvssteuuod sop oed spuess oun Jonb 
-ldde.p oyqissod ong yesAop [I “((g) Uonenbs | oA) uoney 
-ndod sp souuadour xnop ap uOnPUINSd | B JUOUOT[ONUASSO 
oumnsar os auratqgoid ay onbsind “rarnonsed ugq ‘jyueyoduit 
joins 90 IMs yuRLOd xneAvy sone .p o9-jnod BIayIOSNs opoe 
juosoid oJ “(81007) PIM 39 HOdg onb Isure ‘(QQ0Z) [RD 
32 sIedJ (6861) O93 preqnelH uondsoxd yuo ‘d10Ud,p 
SUIOW JUSUIO}{OU JOTNOD je} e soddeis uo asm eI OP 10YJ9,] 
‘npuedol osesn.p jos soisop smoisnid e oseuUOTTHUeYDS || 
onb udrg ‘olAmnsinod as JOATOp xneAPy soy NO oUTeWIOp 
un }so uonendod ey] ap soiquiaul say sno} nod ‘ase,] SUTUIOD 
‘sonuUUOD so[qeLIVA sop INS UOeULIOFUT,, op suopassod 
snou no suonenyis sop e (uondaouos onb Isute sasdjeur) 
XNVABI] SID SNO} SP UOISUd}Xd,'T “Opnyd,[ sp UoNdadu09 PY] 
ap odvj9.] & UONPULIOJUI .pP d1UNd 99 JAsITWN.p UdAOW INT]IOUN 
3] SuTUIeXO JO (6661) SElaneYD 10 MOTSAIG ‘smMoTeA 
op Uy spquiasusd un yuouonbrun ospusid yuaanod soyqeiea 
Sd] NO SdoUISUODSIID sop suURP “(666]) “[]09 310 SsojMeT onb 
IsuTe “(L661) AOYANJOH 39 Moysarg “(L661) PIAA 19 09S sed 
‘sone oud ‘sogIogei[s 939 yUO asATeUR | SULP UONRoIHeNs 
OP SI|QLULA SOP IOISOUI.P ONA Ud SddKdTJO Sopoyj}oU soq 
UONVOYHLYS LT ISO SIMJeIOYT] eT SUeP sJURYOdUIT yUOUNOTGQeu 
-uosiel onbiosy} uonusye oun sapsoooe 939 ke jonbne 
yodse up) ‘(6 omideyo “666 1) preqnesyH 39 WIOY op ImyI0 4s9 
Inapuojoid us spsoge 4sd Jofns oJ NO aseIANO [Noes a ‘oyses 
af onb jJuvjny ‘oLI0ay) ey goURASp e& onbryeid ey no souTeWOp 
sop un] 3so uonejndod ev] ims sutouis}-seo opmd,T 


uOIsSn[IUOD ‘OT 


‘Mpdurosoe & JUd}sSoI 
xXNBAR XNOIQUIOU op NO JURVOdWI sUTeWIOp UN.p jI9e,s 
II ‘So][turey ap surouls)-sed uOT[WURYSS UN sUOLIOUUONDEI9S 
sind ‘sjonprtarpur sed smoisnjd yueudjUO0D sWUIOD « sed 
-O||TWUe] » UN suUOLITUTZap ‘aseUUOTTHURYSE Pp gI1UN | SUTUUOD 
O][TUIL] Vl SUOLIOIOPISUOD SNOU “‘JUSUTOT[AIJUSSSY “SOT S90 
JUSUUD}IOF JURUUOT[HUeYSEINS Ud apuULIS snyd yUdWIATGISUAS 
govoyyo oun sIpuloye.p sjqissod sioje yelos [I ‘seo 
un.p snd jueuaju0d say[tuey soy JoyQUSpI suorAnod snou 


uoijejndod eB] ins seeseq SuloWW9}-sed sapn}y : OOS 


ansoyeieo ne {qX-100-ZI .N ‘epeueD onbnsneis 


Is ‘ISUTY ‘o[QISsod sulouTURSU jsd SadvOTJO snd soyueLIeA op 
uonesiyn J ‘(Guiod 39 Ms pilose .p sed yUOS ou sudTONaUds 
saysisojornuepids soy sno} onb sousI[nos op yudTAUOD 
[}) Sovoy (JUOWUO[QeUUOSTeIDP OIIOA) JUSUOUU.Xd JUDIOS 
suoneloosse soy onb surour e ‘suatonsues soaysisojonuspido 
Sd] JUOSSoIDIUI Inb so.youvsred soy JOUIIYsd Mod uoneULIOsUT,p 
yuowUesyyns sed yUWIdTduUIs yo} JWSsSsTUIMO} ou ‘PIEpUL}s 
surowl9}-sed uejd un e yuourgjddns op ann e onuajqo js 
OQ] [MUL] LP] IP SOIQUIOU SO] INS UONPULIOJUI,| NO ‘sUTOLIID}-sevO 
gyelyuey + opmep surjd soy ‘soovolyo juowioranuo 
SOPOUJOW Sop JURSITIN Ud SUIOUT ‘SdOUII}SO [UI WOJ JOS 
soyelmueyeyul smopuess soy onb jso ayedrouud ey] ‘somos 
-IAOId suotsnjouos sonbyenb 331m ap syqissod 3se JI ‘ao0o91d 
So opejs un e& yUdIOS Ud sUOTeINUTIS sou onb udIg 
(9002 ‘ZO0Z) [109 39 sneyNaN 
SUPP SQUUOP JUOS s[Ie}Op Op SN] g ‘SoUR[QUIDSTeIA op UNUUTXeU 
np onbinouresed-tusas spoyjour ey sed suoneurmsa sap 
% OI & OMOLIDJUI JOS sooIspuod sUONRUISS sap MOVOTO, | 
1or.nb yuepusdso sfquos ]] ‘Opes 90 eB ddA0YNe aNE.p 
UIO] 3So INb ‘UOTRNUTIS oUN kv ILMODEI NP suOAR snoU ‘ouUDG 
‘(QJOOLIOOUT JUSUUIDISEXO 1k}9 I3B.P I[QULIVA VI SUBS d[O9POU 
np uoyeoyioads 9yno} onb 49 dI[IWIe] VT Op SdIQUIOU Sap 38k, 
Ins uoTeULIOsUI.p sed suopgssod ou snou onb jso aweqoid 
one UN) SUIOUID} Sp SdT{IUR] soy suep xXNeTIUUIey sjayyo sap 
joins ne UOneUWOJUT .p nad y10J apassod uo J onb yo sutow9} op 
uo] HULYDS | Ins JUsWUSIOUS onbsoid sagpuoj jUOS saos1apuod 
suoneuUsa soy onb 3sa soawejqoid sop un,] ‘jUasIOAU0D 
sooigpuod suoneumss soy jonboy snod juessoisjur sapour 
un sJajsnie p apqissodum onbsaid a19e,s ]I ‘yuouasnamouyey 
"SQOKdITJOUI Sd JWOIOS sagispuod suoNeUINsa soy onb 99 
B dIpUud}e snouU suOLLIMOd snou ‘sdudIaTFIP spuvss 999 SUUOpP 
wey “007 b © 79h /06b THO I OP splod un uoreme UIOUID 
un jueuosdui0s So]]tuuey soy 39 | Op spiod un juareme seo 
un jueudsIdWIOS soz[IWURy say ‘ajduraxo oou sued ‘asierseds 
[O10ISO] UNONeK JoYISso9U OU ap oseJURAR dUUIJOUD | oO nb 
90 ‘asepuos ap sprod say ed solspuod simoyeuryss sop yuRsTTyN 
Ud SOTIpour sowgW soy Joysnfe Issne suoLUMod snon 
‘TNoTVd Ud asILIOd xo oUTe}IOO 
oun suIOWTURSU apuLWop sieu ‘oyeIDUNS JUOWOTQvuUOSTRI 
UONLSMUTXPU op SUTNOI oUN.p opre.] B d9INDExe aN nod 
a39]duI09 omps00id eT “O9AIOSGO UOTCULIOJUI.p sOLQeUW 
RP] Op ISIOAUL.] Op ondoyeue ouN jURSTTQN ud JUOWOTIOVy 
IOUIT}SO O99 ISsne Jnod SOURLIVAOD Op SOLHeUI eT ‘sanoueIed 
op mojooA Np uUoIsuoUNpP eI 3so d no ‘UOTeUIT}SO,p 
suoynenb9 [+d sop uonnjosal ev] ywormbor suoneuwnse 
sop [noes oT ‘onbrysuresed syopowl un,p udAow ne sogIfol 
JUOS OSeUUOT[HULYSE ,.p oTeUULId gy1UN oUN sUBpP SUOTRAJOSgO 
So] 39 ‘agsljapour ono yop mb osgyioods uou uodey 
oun.p jusUayjanjusAs ‘asuodal ey op pusdap uonvoynens 
PR] NO sUONeNIIS sop suep soisap smorsnyd ve sIyHeNs oseuUO] 
-[queyos | mod soaovoyyo sonbinouresed-mues sopoyj}our 
sop suologria snou ‘(9090Z) ‘T]0910 sneynoNY sued 


orl 


ansoyejyeo ne GdX-[00-ZI WN ‘epeurg onbrsneis 


NBIAIOO NP JOU NP SOUITJOIA 
Sop JUOUUdIdUIOD soUTeLION JOP ‘soT[TWUR] sonNe YG TH6 I 
So] JuaUOD Z aeNs ev] onb sipur} ‘ouruajsp sduia, op 
o]]eArOyUI yHod un yuvInp onbysouselp 99 v seo UN soT[enbso] 
SUBP SOT]TUUIL] O/p Sd] WOUOD | AVNS vy] ‘“IQIWIOp 99900 
qed s9uTULIojap JUdWOIOTJUS sed 4sd,U steut ‘asuod9 s[qeueA 
BP] & OOlJOI JSO UONKOIHeNS eI “IO[ “SUIOWID}-sed opnjd.p 
ued 90 suep stiduios sed jsa.u ¢ o[duuexe | op osevuUo] 
-[Queyoo p urd 9s] 4uepied yuowdjomns ‘aonb suojoN 
‘soMoyegTe XNVTMUR} sJoyfo snorisnyd 
no un jueusiduios ax onbysisoy syapow un Jajsnfe 
B yesoysisuood oyooidde sup) ‘soyerpmueyenui sonbysigjoevses 
Sop UONCUINSI,| & INO} JURAL JUOILSSOIQIUT,S sIMOYoIOYO 
So] SIeUI ‘OWOT[S Np SWIOIA oUN MUDASP ap aITIqeqoid 
eR] ep jeursiew sjapow un sajsnfe mod sanosIp op 
SUOUSA SNOU JUOP sapoyjoUr soy JOsI{WN suotMod snoy 
UIOUID} UN JURIdUUOD saT[URy 
ZOp JO NKOAIOO Np mown) op sed uN jUR}dWIOD sor]WURy 
OLp Ins peyod spne,J ‘[euIsUO sUTOUID}-sed UOTTHURYDE | 
suep souuonsoyes sjofns sop o][muey ke] op soiquiow 
sop soidne sojqeieaod soy IMs 30 NeoAIIO np mown 
ap UOHeNIS BI INS SJUSWIOUSIOSUdI Sap T]]IONdeI yUOWIOTeS9 
JUO S|] ‘oMOVegTe UOTISOduI0S op spoy}eU v] Jed sgUUOT}D9]9S 
SUIOWID} Op o[qeiedwiod uUOT]HUReYSS UN INS jo JOTNONIed 
sduid} op oay[eAsJojUI un yuRINp sonbysouseIp swWOI[s op seo 
SO] SNO} INS SJUSWIDUBTASUdI Sop I]]IONddI JO S|] ‘OOSTOURIY 
ues op oieq ke] Op uUOrIsaI eT suUep “‘NeOAIDD Np oUsTTeW 
mown op sjuenbey snd ey outoy ‘aworls np uorendod 
B] INS SUIOUID}-Sed opts ouUN YSITVOI JO (/66]) SNeYNAN 39 
OYOUSIM ‘SIAR “JosIeg “UPUIMON “OYIIPAY “OO'T “YOSUDI AM, 
¢ odurox] 


‘anbidAy Zasse jso Ins 
mb ayduroxa "J ‘souvyodunt osoruaid 93n0} ap yso oddessenut 
DINOS VI ‘sed 99 sup ‘Jo SoddeJd soy yUOS SaT{IUUIRy say NO 
‘oyeys soddeis ua sseuuo][HURYoS UN SUIUUIOD ddISpISUOD 
ane jnod sydoidde oyod ‘UOWOUUOMAUS | op 39 onbysues 
RP] OP IOI d] IMS sjUSWIOUSIOSUdI Sop IUd}GQO.P JoAvsso.p 
uye ‘ol[uey ev] op soiquiout sop sed oruMoy soyqeieAod 
Sd] 39 Sosuoddr soy Ins UONeULIOJUT,p UdAOUW Ne pJepur}s 
SUIOWUD}-Sed OpNjd oUN.P sogUUOp say IWAdTjJo}9 suatonsuss 
soysisojoruspida say onb yuonboy snjd ua snjd op 3jsa 
[I “lornonsied ugq ‘onbosutynut yos9yuT un oyUSdso1d souepusdap 
op omMponys ek] NO suOnEMIS sop aystxo [I ‘Uepuadad 
‘ouIod vy JUOWIOIVI INVA Ud SpuLUTap vI90 onb omeyuousTddns 
yoyo | 30 oddeisenui sourpusdop ey op sonbryswesed 
SoQpoul op uUOHON.ASUOD eT YWoInbor saovoyya yUSUIOJONUS 
sopoyjou «op §=uonesiyyn,] ‘saovolyjo yuowlayqeuuostel 
yo Jonbrydde e saploey JUOs soyuapgooid suooes xne gyNosIp 
SUOAR SNOU JOP sapoyjoU soy ssoye “(]) [euIsreur syapour np 
sonouesed xne Juowaedioutid suossaigjut snou snou I¢ 


SUIOUID}-SB) SO[BIIMIB] SOpNAy °6 


StL 


$L660¢ 49 SOx oIJUO UMUOYO-IU B JUSUID}OeXO 
onbsoid senjis yso ‘© op mova eT ‘p70 1 GOI 
yuos uonendod sp uoneispuod ey mod sayuepuodsano0s 
sIngjeA SIT ‘PO'O Op UoTHUeYda yhed op sieiq un 
39 % QL Op OKVOYJO oun ouUOp (UOHLINdod sp UONeIspuod) 
I mod QQp no (UOT[HURYDd,p UoONneIopucod) | mod 
I op nary ne ‘ojdwioxo | suep ([6‘0 ~ A JOXY oIIp-k-}S9,9) 
I mod Q] ke spiod sap os8e8e[9,] ‘ofduioxe Jeg ‘oyqeuuOsiel 
stwoiduiod un Jajuossidol yermod  uoynueys9.p 
sptod so] 3a uonefndod op spriod soy oud sMeIpoUgUl 
IgeA uN ‘slojieq “XN JWOTeIPUSTAUOD UOT[HURYOS _p 
sptod soy ‘uoneindod op souuskow x ap oysoid snyjd 
X Op SIN[VA Sap B SUOSSdIDJUT snouU snou Is no ‘sayed snd 
UOT[HURYDI Pp SoT]Ie} Say] Nog ‘uoHeNdod sp sptod soy JasT[WN 
suottmod snou ‘syueyiodut sutou yustos uoTuUeYyse yHod 
op steiq 9] 30 doURLIeA eV] onb mod puvss jUOWTUUeSTNs jso 
uoT[HURYDS | onb 4d ‘agAg]9 JSd Svd UN.pP dI[IGeqoid ev] no x 
op smMa]ea sap & Sa}09 ap swoddes sap sours nod syapour 
9] Jasiyyn.p jso yorsqyur jediourd oou 1g ‘juR}NsSOI o[apoul 
Np oe} SUOTNOA snou onb uoHesTNN,| op yuowomelD puadap 
RaQ {Jesyyn.p juatauos ji.nb A ap moyea vy ys9 oT[and 
‘anbyespenb sua} 
un,p uorsstuo | onb ‘ayqrey snjd nod un srew ‘orqeiquias 
JOYJO UN MOAV JOIOAR,S 19-Sd]J9Q ‘SOSIUUO so[qelIeAod 
sop 19JJ9,] Issne suouruexd snou no ‘(Z70QZ) PIIM 12 09S 
suep soyuosoid yUOS S}e}[NSoI op sIquIOoU puRIs snd uy 
UOT HueqS? Pp 
uoyeigpuod et onb opueis snjd suusAow onbryespenb 
Ino119 oun yWesrMNpoid asepuos ap spiod soy Jed uoNeIspuod 
RI ‘ayqro oumtuod uoNendod ap moayea ey suotussd snou Is 
SUSU ‘sed 390 sURC] “pZ‘() SP IeJOS UOTTHULYIE Hed op sTeIq 
9] 19 &% Q] UOTAUD,p onb jeJes ou UOT] HULYDE ,_p UoNeIgpuod 
PR] op sayepar gyovwoyjo, “(e) | amsy ev] op uonendod 
el op med e ooz = ‘uv = %u ater ap soydums somoyegye 
suo]]HueYyd9 sop suOoTUUONOS[9S snou Is ‘anb suO}ON 
‘o[e39 UONeIOpUOd x] op sed o] SUep onb 
(onbsu jney ev souuosiod soy mod omMp-e-3s9,9) UOTNGLASIP 
eR] op amorioedns ononb ey op aymuenxay e snd sonjs 
x op smaeA sop mod seudoidde ajyuod vy] ap uoNeuUNso 
oun ynpoid uolHueYyos,p uUoneIspuod ey ‘soLreugos 
xNOp So] SULP JUOUO\SOFULPY ‘“SUTIOWID} Op 30 Sed ap 
xNeBd SOIQUIOU Sop SUOMI snoU Is UOTTHULYDS Pp UONeIopuod 
R] & puodsauod MayeA spuodds eT *(« xnedq » sagjonby9) 
S00 =A y («KUONRINdog» sagjenbN9) oO" =thupanod 
soguuop quos '“g yo “x op smoyea sor] ‘onbrydesd np seq ne 
JUOS 9] SUTOUI9} Sd] 39 S¥O So] INOd saTJoUUOTIPUOD soyIsUOp 
so] 30 onbrydeis np omonodns onsed vy ev aqquasaidal jso 
X op oeqo]s suIsuspP VT “$166'0 = "M OIP-k-3S0,9 “OOP IMs 
I 9p wos uoneindod ev] suep seo op uonsodoid ej onb oy0s 
op soxly 3so Cd op moayea ze] ‘soLIeUgOS XNop soy sueq 


900Z auqwias~ap ‘ajenbua,p senbiuyoe | 


ansojejeo ne {qX-100-ZI .N “epeurg onbrysyeis 


“xnes9 spiod soy 39 uole[ndod ap spiod say] aque uosteredwod *] ansiy 


LL‘ = 'g 
7‘€ = 'g ‘uonrindog 


oxnesq 


80°C 87‘ 


xne3q % 
uonrndog . 


 0orans T 


19°% = 'g 
681 = 'g :uonrjndog 


ixnesq 


a= 
- 
- 
- 
. 
- 
ca 
* 
- 
- 
- 
a 
- 


(x| | =A) 1d 180] 
(x| | =) 1d 130] 


near 


Cie 40 | 


XEO-— xT + J = (BY | 
aattsod anbyuvapend | 


‘uoryetndod ej op miede goz = uv = %u oye 
ap sodumis somoyegye suo][WURYDS sap sUOTUUOTDE[9S snou 
IS S¥O SOP % (IG UOIIAUD SURP dOUR[QWIASIvIA op YOddel np 
plepur}s 1S9} UNp opTe | & 9[999P WeIas 10-mnjJao onb aja} Q 
Op INITBA SUN SUOSSISTIOYD SNON *Z {Aud xa | INS JUSWIOAeUI 
-Txoldde saseq ‘oaAnesou omaqimos oun ‘anne | 39 dAnIsod 
ginqinod oun dseaAe UN] ‘soleus0S xXnNap suRp UOTIsod 
eT oASNy]E (7007) PIAA 3° HOIg op ogidepe ‘] omsy ey 
‘uonendod ej suep x op ouudAoUr mMoyPA eT Op osE]URALp 
ayoolidde s uojjnueyse,p uonerapuod ey] soide.p soumnyse 
ajuod ve] onb stpury ‘agaaq9 snyd yso seo uN,p ayI]IGeqold ey] No 
‘x op sopueis snjd smoyea sop mod oued ve] ap uoneUIYs 
oun yuNUUOp osepuos op spiod sap uoNestyN,, onb oy10s 
ap “°o onb pueis snjd yuowiayqisuas isa °y ‘UoWaTTomIqey 
uj°u=°o =A ek puodsaliod uoynueyoe.p sptod 
sg] Ied uoneigpuod vy aonb 39 Py = A ve puodsazioo a8epuos 
ap sptod soy sed uonesgpuod vy onb suojsddey *[ e& Q op 
assed A op moyea ey puenb syuou3ne “x onb yo “x yo x 
aud stiduios smof{no} jso ‘x onb SIdAG Ss [x > \Patonb 
aos op ‘9 < 'g onb suosoddns snon ‘seo ap uoneindod 
eB] suep xX op onpusyye moyea ey ‘x pos 30 suTOUIa) op 
uonendod vy suep x op onpuoye nayea vy Px yog “x = x 
Jed mayea 93390 suojoUad ‘oqINOD eT Ms gQuUOp juIod un 
B a]Joor oquad yy ve [e89 180 '“g > A > K INO} Mog ‘aqmoo 
®] Op BuO] a] suodeydap snou snou onbsioy aurea ‘xQz + '¢ 
WSO] [OYO9,| Op sjoor ayuod vy ‘aodUapIAd 9yNn0} 9q 


uoljejndod ej ins seaseq SulOWs9}-Ssed sapn}y : WOIS 


stone seconasnt to emrtan eure ROR 


2X90 — Xp + Of = (x) NBO] 
salesou onbyvipengd 


‘yyod jsod Q no 


(61) Oe ie ee Or hl ao 


suosip ‘onbyespenb j10s 
[291 dTapour oy onb steur ‘sojoo op yoddel np swiyyWesOo] 9] 
Iod saneorydxs sjqeueA onos oun nb jueUaUOS OU STIeOUT] 
g]gpowl un suonsn{e snou onb suosoddns “sa1pijduts mog 
‘(cousnbgsuod Ud SOJOT[OUe 9.9 SIOTe JWoTeIASp nb sayapour 
SOP UONLOTFLISA op soyuRINOd sompsdo.d say Jed s9fa09p JOS 
spueis so] ‘adiourid usd Jeo ‘syreo9 synod xne suossoi9yUI snou 
snou) onbysyjodAy sjapour ne z10ddex red sojqrey syed9.p 
sio] “q & OAL Inb 99 guTUexO suOAR snou “(ZQ0Z) PIEAA 
yo 09S sueq ‘A op onb Isute ‘soyqeiIeAod sop UOTINGLySIpP 
e] Op Jo Jegr sfapour np puadsp mb “('y + °y)/°y = 4 
sone 4g =«suosip “(6)Uonenbs,| op uoNnjos ey] sIoA 
dBIOAUOD (QT) JURSIEFsHes “gG JeIoUSs IMoyeuINse oNON 
, ‘uoTTNURYDE,p 
aye} ke] op omeniqie xioyo np spuodsp souslgyul Moy 
ap s{qIo eT onb JuRsteysnes JUSUUOJONUS JUOTeIASN! solo 3.QUd Pp 
nod yoy onb suuodsdnos af yo uonendod ey soide.p susp 
-uod Imoayeunsa | JosI[yN.p sjqejea JUoUUeSyyNs UOsTes oun 
SUIUTOD [NS IN] B JUSWIII9 390 JUOTeIJOIOpIsuOS souUOSJod SoUTe} 
-Idd ‘sogstTyn sosarnonsed suojpyueyse,p soyjie} sop puodop 
SUINSd UoTHUeYSS | ap UOTOUOJ Ud dIOpUod soOKOTJa snid 
Inayeumsa | aonb 90 ‘anuos Jeg ‘uonendod ev] sp squuasud | 
Inod saguuop ep suorsodsip snou Is suotmpuengo snou onb 
onevourl] onbysiso] uoyeurxoidde,y smofno, summso uonefndod 
R] op UoTOUOJ Ud oJopuod MojeUSd,| ‘UOHONsUOD Ieg 


vvl 


ansojeyeod ne GqX-[00-ZI N ‘epeurD onbnsneis 


EFHOCOLIO.P 
ures np xuid a] ssoje ysd Jon?) {JOOMOSUI 4S dJo=poW 9] 
IS [I-J-ossed 9s on) ‘wed onbjanb asard un Moar A pop I] 


assajsnqoy °g 


‘soguuonooy.iod snjd sapoyjsut sap & IIMOdeI 
SIOTL INV] |] ‘IOS Ud yURSsoID UT 4so oddesse.nuT yUSUIO}IOdUIOS 
3] “6 UOTIONS BT B UOTJSoNb 4sd [I JUOP SUTOUID}-Sed OTeITIUUILT 
apne, sumuo0d ‘sautatqoid sureyis0 mod ‘onb jyuepusdss 
suousi[nos snoN ‘sonbridura xneaey soy osAInsinod op 
JIVIPUSTAUOD [I NO SUTRUTOP Ne UN ,P SIOJIINO} j13L_S [I STRUT 
‘goustiedxo o.nou Jed syiaanoo sonbyeid syyoalgo sop yrednyd 
PR] nod sjey[NsoI suog JUOWUUeSYJNs op yUoUUOp jd JasITNN eB 
solovy JOS (UOT[HULYDI Pp splod sa] ddAv) SadJOpUOd yUOUUD] 
-jonsed o0y pp sopoyjsut soy aonb jsd omostAosd UoIsn~oUOS 
ONON (1) [eursrew sfopow np sanouresed xne yustuenbrun 
SUOSSOIQUI SNnoU snouU IS sUIEd ey] stewel onbsoid espnea 
ou UONeSI]Spoul ev] spuewisp onb omeyuowsjddns jieaen 
a] onb sasued e yuoUUOp s}ejNsoI siomuoid say ‘suonry] 
-NUIIS SOUTELIDO JOINIIXS B SOUSWTUIOD SUOAR SNON ‘dseUUO] 
-[QHueyod .p someulid soytun sop mowgUI,] @ soURpuodap 
op sINjONs ve] JOsI[spour ev sjoid SOUWUOS snoU IS saoROTTyS 
yUOWOIONUS sonbinourered-iuas sin9}eUT}so sop oitnpold op 
J] qIssod jso [I ney snd suUOTJUOW SUOAR | SnOU sUTWIOD 
‘¢‘] UOMAUD JUIOVe v UTC Op 39]J9,] Op 
IgeA ey onbs1OT UWONSdLI09 sp spoyjour ey] onb sovoyyo snyd 
ONUSASP ‘jWe} Ud 4sa JOY po spoujoU eT 39 WeJUOWIsNe ue|d 
op JoJJo | onb omsour ev yUoWAIssosso1d snsedstp yuo sures 
Sd] ‘SoJV.NS So] SUBP sd}TOqUIa soddeis ud ost eI & Sassed 
SOUULUIOS SnoU pun?) ‘sayeVNs sap sfquiosua | ins soddeis 
Ud SST OUN,P UOHONpOHUI,| op sso] sourgu say said nod 
B SOQINIUIDP JUOS SOATLIOI SATIVOTYO SAT *°% QT & IMoLIodns 
99 steel BU D0Y pH spoyjoU ke] B JUOUTAATeIedUIOD (10-seO 
99 SUP d}9[dWIOD SOURTQUIOSIeIA Op UINUITXeU a] 3S Inb) 
UONISLIOD Sp spoyJoU eI Op UOTWSTTIIN,| & NP sIOVOyJO,p 
ules 9] ‘soddeis uo ost ounone sues ‘[ Inod Q] UOMAUS & 
SUIOLU9} OP UOT[MULYSI | SUP d]qQIey snyd ve] ve OpueIs snjd P| 
9128 op oseUUO][HULYDE Pp UOHOR k] Op ONvI 9] SUOXTJ snou 
10 7 o[dwoxe| op oysurusW ve Op opmd,] IMS sopuo} yUOS 
solieugos sop yednyid eT (Z00Z) PIL 38 HOSS sup sazLIO9p 
JUOS SOUTeLIZD JUOp ‘suOnRINUNIs smMoisnyd syndaxo sUOAR 
SNON {19-Sed 90 sUep sILOVOTTJO,p UIeS oNOU ysa JON) 
‘QJa “SodAj-SINOLIA Sop SUOTIUITYSS Sop 
MUMOJ 9 s[apour 9] Joysnfe nod gsijyn ono Jnod suonsa.109 
sop Jonbiydde,p jowued mb ajonbua,p sasuuop op 
asxjeue p swureisoid ynoy ‘siopy “gx + “g = (“!d)n8o] 
juexy uo tuyop “d sed “'d yuedsefduios ue (91) uonenbe J 
JOsI[NN .p JYFNS snou |] ‘JWWouderpoumunt someniqie ssepuos 
op surid sop ke asT[VIOUSS 9S LIAD (86 UleD 10 MOTSAIG 
onb Isure “9g6] UMOIg 30 SIvdJ JOA) (9]e}0} UOU onb Ionb) 
IDAITO JUSWUDTFONIIQeY BOKVOYJO SUN DIA SJUDIOYJOOO so] 


ev 


sno} od syUss19AUOD sMo}eUTSS sop yMpojd UOHRoTHeys 
op gqeueA ke] ap suoNouoy sop puoiduiod x IMa}d0A 
3] no yo “°g out1a} op sed yURUD}UOD OU SoTEpOU So] suURp 
SUOT}ODIION SOUIQU sop UOHONponUT,T “(AT = ¥) 9 
stidui0d A ‘S}UdIOYJO0D say sno} ap ‘ssovoJo JUOUIOIOTUS 
‘SoJUISIOAUOD SUOTILUITYSO sop yNpoid (¢]{) UoKHenbe,] ssoye 


(gt) “dx + Md + “9 = {(q sens *K | [ = 4) d}180] 


onb suosoddns snou 
IS OJIp-e-}so,9 UoNdatI0a sumutod (“YY My / My My) Boy 
= q yoenpur ua (pT) sgpour sa] —suoyIpout 
SNOU Ig ‘oIpUd}d & TINK] ste ‘aovoyyZo sutou nod un UsAOU 
UN 9}SIX9 |I ‘SUTOWURAN ‘SoxoTduo0s snyjd sseuUOT[HURYDS9 .p 
suyjd sop e& Jasijeisuas soy op ajUOpIAd sJoTUeU oUNONe 
O}STXO U [I 10 ‘saves op soUUdAOU Sop SdITeOUT] SUOSTRUTG 
-W09 sap sed jUOS OU soyURINSOI UONeUITISO .p suoKenbe soy 
sIeut “(L661 AOYQNJOH 19 Mo|sorg onb isure “L661 PLM 19 
09S MOA) ayes onbeyo suep soIy JOS SUTOUI9} Op 39 SBd Op 
Q[duris sMoyegTe SUOT]HULYOS sop NO UOHENAIS VI SURP SddI0q 
-P[9 99 JO dORVdIJJa JUSIOIONUS sopoyjoUr soq ‘so[duuts 
Issne sosond JUOS aU sooRVOJa snjd sopoyjour soy ‘aU. Jeg 
‘OuTessooau S89 ,U onbioay yuataddoyaasp nesanou uNone 49 
‘ane J 39 oun | yuonbijdde.s g uonoas ev] e sasodoid stwoid 
-W09 op uoyeIgpuod ve] 3 osepuOs ap splod say Jed uONeI 
-9puod op spoyjsw ey] °7 ajdwioxe,] suep onb | o]durexa | 
suep Ue} ‘oJopou anoU suUep o8e.] Op oIIeOUT] UONOUOJ 
ouN OIMOUI IMO[NOA UdIq VOJ suoLLMOd snou ‘oduoxs 
Ieq ‘SoyoNU sojqeuea op spre. & MJOUT soy op nol] ne 
asst] onbiysuresed 9g.moo oun JURSTTIN Ud 938.)S Op So[quUeA 

Sop UOTNQLAUCD I JOSIT9POU suOTNOA snouU ‘sIojIeg 
‘uoneiopuod ey sed sogyie.n ong JUOWO| CUTS steuT 
‘ued np suoneoyioeds say suep sasnjout on9 sed JuoreIAop 
OU So[q ‘aseuUOTTHURYOS Ud dU} Np jonjyIqey suds 
ne ses op snd y13e,s ou [I ‘7 o[dutox9 | suep syOTUIO | Op 
JO 938,] ap jo ‘| o[duiaxa | suep 98¥ | dP Sed 9] 4S9,9 SUTUUOD 
‘« SoyBS » Soy] JUdNoOdaI sseUUOT[HURYOS .p someuTLId soyrun 
SO] IS ‘SIOJAINO]L, ‘pslepuLys UOSe} LI OP SOSNOUI a9 JUOAIOP 
soyeQs saq 39 oWgTqoid ap sed e A. [I ‘] o[dwoxe] suep 
sonbrydeis098 suoIsai sop sed a] 4Sd,9 SUTUIOD “« sayeS » 
Sd] SUBP SddTOQUID JUOS dseUUOT[HULYE Pp someUd soyrun 
So] IS ‘ueyd np uoneorsioads ev] suep « sayes » sap suojadde 
snou onb 99 suonjour snou jWOp Uodey ve] B UONUOYL oIey 
SUOASP snou onb suOoJON ‘asepuos op uryd 9] Ins soridoidde 
UONLULIOJUI. | 32 splod sao jyuesmMponuT ua dsjgnbua.p 
soguuop op osAyeuR Pp prepur}s ouUeIsOId jno} suep sisnfe 
ang jnod gfepow ag (HS T=4:1'0 =9)"S suep 
sostidtioo sgyun soy mod “mu 'S??Z "uy x Hm soar 

s21 4 
CLT)s ee Ove Cit x) dh) on cake its 

UOTJVUISS ,P 
uonenbe,, ouuop (p]) Uonenbs, suep uoTnuRYs9,p 

souusAoul ~xne smoyeunsd sod op uolNYSqns eT 


900Z aiquiacep ‘ajenbue,p senbiuyoe | 


Urey 


m iP 
((g : o.§). ee U4) Uy Hay a 


Jed 
o,durexe sed ‘ayqeuuosies osepuos op uryd yno} op jueudAoId 
SOOUUOP Sd] JURSITYN Ud SdIOTUJOp soo JUSUTOTIOK} JOUIT|SO 
suoAnod snou ‘jens op souusAour sop onb IMuUdAIO,UI 
wey ou (pT) uonenbe, onbsing “(MY Mm “Y)8Oy 
= ™qg soak “q+ Mg = “g 30 'g = 'g uonnjos mod e (g) 
uonenbs | Sioje “PIfLI9A Iso (ET) BJQpout 9] 1S “9yHeNs uoU 
Sd 9] INod sgsT]IN UOTLIOU PI] IP dJUAPIAD UOISUd}X,| DOAP 


On “T= Uo "2xo or nS 


Y 
MG) dex hy) 


Op UONNIOS PJ SISA JUDWUIOUTeLIOD onbsoid sas1OAUOS 
(4) ep uonnjos eT ‘ao < “uy “°u onb omsou Vy 


40 “Ty Y 


sar = seo ay Ke 
(de xyod-s Ke (Gx) ox < 


}So () UoTYeUTSO .p UOneNbe | 9p sIjWeys JuoTeAINb9 | 39 


(SI) 0= 


(r1) td x t+ Mg = {(y oreng *K | 1 = Ad} uso] 


JULUDJUTCUT JS9 S[QPOW ANON “xnevI9UEs 
snjd soynens sued sop e& orpudjd,] Op a[loV] Zosse 3so 
Il (6L61 2yAd 39 SONUdIG) SOURTQUIASTeIA Op UNUUTXeU Np 
sovoyo onbiysuresed-tuuras spoyJoUr VI 3S9 (ATUA}QO Soy INdA 
UO | IS Aes op UISIO.] e SogUUOpIO soy mod yuouW;snle 
ojduis un ooaAev) omeuIpio selopuod uou onbmsisoy 
UOISSOISOI RI SJOTe ‘oyeys onbeyo mod souNsIp suIsuO | 
B® s9guUOpsJo oun puUdidi0d s];epoul sou Is “JorNonIed 
uq ‘Jonbiydde e saylory jo soljqeja UdIq SaovoTJo JUSWOIOTUS 
SOPOYISUI SOP d}STXO II ‘ayes onbeyo suep SoJI} JUOS SUTOUID} 
op 39 seo op sjuepuodapul suoyjHueYyoS sap no ‘oIjnes 
amoyege oseuUOT[HULYSS, | Op JolNonIed seo a] sueq 

Zonbyneurgysks snjd syooidde oun yurydope us s}e][nso1 
SIMOT[IOU SP ITUd}GO SNOU-SUOLLINO ‘2OY PY JUSUWIIIONUS 489 
a]Jo stew ‘onbyeid usd s}eynsai suog Zosse.p JouUOp s]qQuUIas 
(uo][WURYD9,p suoNJodoid soy jyuesl{yN ua suonendod 
-SNOS SO] IJOUIQUIOD STRUT “UTOUI9} 9p NO seo op UONENIS 
ve] soide.p soruyep suorejndod-snos say suep osepuos 
op sptod say red prepurys uolelopuod vy Jost{yN sIIp-ke-1Sd ,9) 
quepsosid uonoos ev] e gsodoid stwoiduios oT 


IyHeVYs osvuuoyHuvyoy */ 
"2 UOTIOOS PT B UONSONb 93390 SUOUTLUe Xd SNON “JOWITSA Pp 
yuoUTeIA suoAessd snou onb 90 e& INYOSTJ{OI UdIq SUOADP 


uoljeindod e| ins segseq SU|OW9}-Ssed Sapn}y : OI 


angdojeyeo nv FdX-T00-ZI oN ‘epeuRD onbysneig 


SNOU SJOTe “SJOPOUW Np SIdUdIDIJSpP So] IOSLUOS op soyqedeout 
souwwos snou Ig ‘oIfioeds jeul a39 & d]9pour a] onb 
JUSNHIPUT SJUSIOIJOOS Sop SUONUI}SS So] dQUD S}ROTTUSIS 
SLB99 Sap ‘aNUOS Jeg ‘SOdUISd sodAj-smMoLId so] Ins JuRseq 
snou ud yuowosnf un JajJod suoAnod snou sioye ‘sayqv{quias 
JUOS SJUSIOIJoOO sop suoneuisd soy Ig ‘uoNeindod op 
sptod soy onb tsure uoypyueyse .p spiod say yuowonbyeursysés 
jyuesl{yN us sjepowl sf Joysnfe.p yuopnid sjquies |I ‘10s 
Ud [I,Nb Ton) ‘Tor aIlessad9u 3sd ‘sonbr1o9y} onb sonbinduuss 
juR} “xXNVAR]) Sop aIMsmod vy] ‘AoUapIAd 93N0} aq ‘ayOKOTJO,p 
sures sols op yuoworel ympold uolueyss.p spiod 
so] Jed uoneispuod op oisaqyeys ey ‘ooudtiodxa sme] suep 
‘nb sonbrewor yuoy (L7¢ a8ed “GG6]) PIeqneIH jo WIOY 
‘apmd,.| @ owia;qoid np onied opueis uo ospuadep jusanod 
uo][HURYSS,p uoneIspuod vi ayjonb sosejurae soy] 
‘YN Op xIOYO o] suvp juRyOdu snyd aTor uN Jonof 
quorermod g uONdES ek] B SUOINOSIP snouU yUOP assoysnqol 
RP] B SOATILIOI SUONVIOPISUOD So] “WINuATUTU UOS ap said 9ye][d 
So Y ap UoNoUOJ oun ysa {“d}aoDd onbsind ‘7 e moreyzut 
4Sd SUIOW9} Op UOT] HULYD | ‘op ued op yajjo.] onbsioy 
SUIOU NP ‘SoTqIey JUSWIOANLIOI JOS suIeS so] ‘sIOJaNOT, 
(21007) PIE 39 NO9G SUeP SoyLIOgp sooyUMT] suONeTNUITIS 
Sop SUEP d}1OKDT]JO,P SUIVS sSUTe}IOD JUOWIOATOOJJO yINpold 
ayooidde ayj9¢ ‘syey[NsoI sMoy]Iour op yUoUUOP sayueTeAInbs 
uoT[HURYE,p soy]ie}] op ouoJ uN IMs soseq splod sap 
onb 99 & aIpudye snou suOLLMOd snoy ‘dovdTJJo JUOWUAIOTUS 
snd 4sa.U ao ‘saxayduios snd o8epuos op suvjd sop mod 
STRUL ‘SUTOUI9} Op 10 S¥O Op soTdUNIs soMOyegTe suOTTHURYOS 
sop e& omeye e uo nbsio, osfquodsip sovoyya snyid 
R] oIsg}eNs ke] 1SO UOT]HULYDS.p splod sop uOoHeRsTNN,T 
“SUOTILINUITS Soy SURP 
uo][HURYD9,.p sptod soy Jed UOneIspuod op seo Ud s[eUTOU 
Igjea ek] op oyooid snd je}9 DOURIJUOD Op sa[eAIOIUI 
sop omMpOANodD ev ‘YoroIns oq ‘oddevis uo osm eI op 
JOJO | Weyuousne nb 39 uoyRIOI vl Op IdJOJ LI WelpIsusjUT ,s 
onb omsour e syueyoduit snjd yuareusaop sures soy ‘uon 
-ejndod 93390 Ms sogseq SUOTL[NUIS Sop suLp 19 7 9[CUIOXO | 
suep snjd no % QS op gOVOJO.p sures op 3e}O Wey 
WO (ZO0T) PEM 39 NODS “(’M = “Y) UoHRIndod op sprod 
sg] onb yoynJd (u//u = ’Y) UOTTHUeYOS .p splod say] JUesTTHN 
uo sjueyodumt sures sop Jasijeol yUoAnos suoanod snonN 
‘v ya 'y op snayeA sauUOg Sop Joplosp & 9}Sd1 snoU I] 
"‘yEYNSOI J] Ins souapiout .p sed vu oytyeuUoHJodosd 
op ojurjsuoo eT op xioyd af onb suousljnog ~“xtoyo 
o0U op owuueISoId 3] suep ‘(oeseuUOT[MULYSE Pp soseWLd 
soqyiun ‘saje.ys) osepuos ap urd np amjonys ve] op sTfonjiqey 
uoneoyiosds vy ooae ‘olmponur soy sind “°y e aljou 
-uoniodoid y10s surowis) sap xno ap oumuos ey onb jo 'y 
® o]Jouuonjtodoid ylos seo sap xnd0 op oumtuos RP] onb os 
ap “uoussed9s SUTOLID] Sap 39 S¥O Sap spIod sa] JOUUOTIYO99I 
yuowoyduis suoAdp snou 4p yuowonny (‘0 = 7)’S 
suep sastiduios sayun soy mod ‘m S*'Z/im’y 2% im sone 


cvl 


andoyejeo ne G@dX-100-ZI .N ‘epeueD onbrsneis 


uoTnueYys9 
(1) o=(gi'x)'d-“)xm  =()'s 


QULIOJ B] SNOS dI1IN9 ,S 
ynod (6) uoryeusa p uonenbs,] ‘siofty (QO = A soyjonbsoy 
mod sgytun sop syquuasud |) suToWI9} ap UoNefndod-snos P| 
aj0usp °s9 19 (| = A soyjenbsoy mod sgyrun sap sfquuiasud | 
dIIp-R-1S9,9) seo op uonendod-snos ej s}0u9p 'g no 


'g31 


GDN Nn Merete: ememee eghiy 


((g ‘’x) 'd - '€)’x'm"¢ 

onb suosoddns 
‘yuowlastogid snjg ‘sptod op audoidde mayo0a oy yURTpIO9ds 
ud Justa|dunis ‘axeydwos asepuos op ued snos onbiysiso] 
UOISSOIBOI BI JoyeN op sqedeo jororsoid jonb oyodut.u 

op USAOU Ne JUOUTATIOKJ 93NDExd a9 ISsne jnod vI90 JNO L, 
‘OOUITISO 
suushowl oun yuourojdums ysa (q)’t onbsind ‘piepurys 
asepuos op urd yno} mod jyuowonbyeurgyshs o]qruodsip 
ono ywelAop mb oyjemriqey oasepuos ied uoneunsd,] 
sjousp {(g)'H}aog ‘oY “{(g)°t}aog oy + {(g)'taog 
iv = (9) *s}409 % ~=(,9e/(9) “se-) = (d) “re  oaae 


(11) “-Cg) “er {Cg) “S} 409 -C'g) “er = {“g} 009 


(« YOIMpPURS >») SOUSA SOURLIVAOD Op SOLNeU 
9uN B JUS snou Inb 99 ‘UOTRSLIeOUT] Op prepuL}s sJUOUUNSIe .p 
aple.| B@ onusjqo ang sioje ynod “g op souvlvAoo op 
some eT (1°09 = 7) {Cd °x)/d — 1)x}’y uonendod-snos 
op sUUDdAOU BT Op UOTTHURYDS Ins IMoyeuTsa J sd (g)’1 no 


(OI) ‘o = (d)°d°v —- d)'d'v = @)‘S 


yrejsnes nb xne1gues aseuuOTHULYDE .p sued soy mod 
‘“g suosip ‘moyeurnss un o198Sns vjID ‘pslepuejs asepuos 
ap ued yno} Mod souusAour sod JOWINSd aJ00Ud suoANnOod 
snou ‘uoneindod-snos sp souusAowl xnop onb IMUdAIOJUT qIRJ 
ou (6) UoneNbY | op siquuo JomUeid a] onbsing ‘saxayduros 
snd oseuuoynueyse .p suvjd sop e suossed 4ueudquTeyy 
‘uonelndod ev] suep seo op uonsodoid ey onteuu09 
op UoTIpuod ke JURISUOD OUID} np jofns ne sooUdIOzUI 
SO] JOSLUOS Op aIOVJ 4Sd ]I “O[duNIs sed oy] SUP OUTLIOD “(1 ‘0 
= 7)0 < ’¥ yo} mod juR}sUOD UIA} oy Jnes “UOISsoISOI 
Op S}UdIYJooD say sno} Imod syussOAUOd smoyeUIsa 
sop ynpoid (g) uonenbs,| sp uoNnjos ev] ‘ouog ‘[aAnoid 
P] Op sjiejgp sap nod (9861) PLEA 19 HOog Moa] 'y “ry 
op sanisod mayea ono mod ('y°v/°yly) 80] = “g ooae 
‘q+ °d = %d 10 'g = !g uonnjos mod ke (g) uonenb9 
SIOTL “SLFLI9A 3So (T) 9]Qpou oJ Ig “10 =7 mod 7 = Xx 
onb jueyors oayouuoMIpuos souviedsa , s}ousp {}’7 no 


(6) ‘0 = {C9 *x)'d x}°F °v — {C9 *x)°d x} "9 'v 


LVL 


ap .g UONN]Os z SJoA JUOWIOUTeLIOO 
anbsaid o819AU09 (g) dp UONNIOS ve] ‘UoNeindodiodns vy op 
Imied e a919U98 js sTUTE UONR[Ndod ev] yUOp UOSe} ve] eB JUeNb 
so[qiey sojuTeUOS sap snos ‘co <— 'u “uv onb omsow Vy 


v7 ly 
(g) a) = suloul9} oy seo Pn 
(g<'x)'d'x ak CSN ae 
uOT}eUINSS ,p 


suotyenbs.p [ei9uas o[quasUd | op SJot~NonJed seo sap yuOsS 
suorssaidxe xnap sag [9 = 7 mod ‘('u + %Uu)//’u = ’@ no 


°u 'y 
(Z) ‘0 = SuIOUI9} °o ol Ln estos 'o 
(Gexraa (gPmyd x 


SULIO} 
B] SNOS DOULIQUIDSICIA OP WINUWITXPU NP sdvdTJO INd}VUSO | 
Inod (¢) uonenbs,, om199 suoAnod snou ‘owgur oq 


94 ly 
OV 
SuIOUI9} M 


(Gx) dex. 4 


ae EE 
(g <'x)°d 1G 


SULIOJ BT SNOs d1apuod 
moyeunnysd | nod (¢) uoyenbg J o11I999I1 suoAnod snou sioye 
“(gq ‘x)'d — | = (g‘x)°d onb suosod yo AV sed Buoy ne yo} 
SUOSIAIP snou IS “[‘Q0 = 7 mod ‘a}eNs ey] suep uONendod 
eR] op uoniodoid ej ajousp ’y no ‘/u//y x ‘mM spiod 
uN JUO 7 NCS k] op SoyUN sa] soyno} “Ioy “SUTOUID} Op 93e.NS 
eB] op yueusAold °u arIe} op yuepusdapur ojdumts onojeaye 
uo]]MWURYOS UN jo sed op ayes eT op yueucAoid ‘vw aye) 
op [duns amoyesye UOT]WUeYDS UN sUOAR snoU no ayUapso—gid 
uonoes ek] Op UoneMmIs eT e& JURISUT UN suOUdAdy 

"somejuouratddns 
suoneorduios ap don sues sye[Nsol smo[IOU JUOUUSTqISUaS 
op Iud}qo suoAnod snou ‘yey uq ‘qUapsogid UOTdesS 
eR] & uMUeXo o[dumIs sed a] Inod onb soxayduros osepuos 
op suvjd soy mod saovoljjour Issne 3no} JOS sajo ‘uepusday 
‘sooiopuod suoneunysd soy ms omeqei snou smofno} 
suoanod snou ‘Juowoayomen oyovoyyeo,p don oipsod 
sues oyduis snjd op ssoyd onbjanb osey snou-suoanog 

“QUTINOI op SasATeUR Sd] SUBP SUTOUT 
np ‘ojqesiey ona mod syoyo,p don dnoonesq spuvwap 
QO1NIOX J ‘(a]duuoxe Jed “6 UOT{DES BT & SODISPISUOD SUTOUI9} 
SO So]eIIWUL] Sopnyd so] suep sUUOD) Ios ud oddeise.nuI 
MINIONS BI B SUOISSdIDJUT SNouU dU snou onb suIOU VY “(9007 
‘ZOO0T) PIEM 39 NOdg ‘sneyNoN suep sgi]!eI9p sjuoUIoUsTOsuOL 
Sop BIOANO] M909] OT ‘asvuUOTTHURYSS,p omeuTd gun 
oun suep sosuodal sap 1m9}99A 9] Nod soeAN[NU sayapour 
Sop dIIN.SUOD B 98I[GO snou vYIIO sIeuU ‘(adepUOS op sprod 
sg] Jed uoneispuod ap oysoidde | Jue.yyo sjororsoid say sno} 
SUEP dj} d]J9O UOSe] 93N0} ap yso Nb ossoyJodAY) soje.s soy 
suep JUDWILUepuddopUl saguUOTDETES JUOS SseUUO]]HULYIE .P 


(9) 0= 


900Z aiquisoep ‘ajanbue.p senbiuyoe| 


omeulid gun sat onb juesoddns ua ‘soisop simorsnid e 
dIpHe.Ys sseuuo][Hueyos ,| Inod soovoyjo sonbuyjouresed-tuwues 
SINDICUI}SS SOP JOALIOP 9p s][qQISsod js9 [J ‘(oxoyduio0s as euUO] 
-[nueyse p ued un uojas sgUUONDII9S JUOLUIDTeda JUOS seo 
Soy ‘[ o[duuoxd | SuUBp SUNOS ‘UOIsed90 J B) a][9Y99 opuLIs 
B SUIOUID}-Svd SapNyd so] suep aJuonbezy snyd ua snyjd op 3s 
UOeNAIS 909 ‘UOHONPONUI,| SUP 9UUOTUSUT sUOAR,] Sno 
oUIWOD ‘s[dUIs oNOyegTe oseuUOTTMULYDE Ied onb jon] 
soisop sinoisnyd e oxo[duios aseuUo][URYSE Jed snus}go 949 
JUO SUTOUID} Sa] *Z UOIOS BI Op sayduuoxo xnop so] sueq 


dxojdwios snid ssvuuoyuueYyIy =*9 


‘Pwo 
son ono ynod uoneindod ap spiod xne 9a;0LNs UoIsoUpe.| 
op xud oy uowajsaytueyy “(suorsIooid op snjd mod e{QQz 
PIIM 3° NOdS MOA) UOneUTXoIdde suUOG oun JoUUOp ke 
sousuTUIOD onbyoduAse s1IOSY} LT NO JUOUIOW 9] SUTUID}Op 
Inb JUSUII{9,| ISO SIOTUIOP 93399 JO UOT[HURYDE,p SAMATJO 
a]Ie} PT WNper uoNeIopuod vy ‘JUWTJaNUassy “oyqley 3S9 
sdolgpuod suoneulyss sop sylovoyyo., puenb ynoyms “‘UoTTH 
-ueyoe yyod ims sojoridoid samo[Ioul yUOWOyOU ap MOA 
B souRpUd} JO saljo : soolspuod suoneumnss xne yodde1 
Jed osejueae anne un doJooud jyuojUasoId soUR[qUIOSTeIA 
op UINUITxeU Np suOTeUT|sa say onb suojou snou “UUG 

‘(]qQrey snd a1O9Ud 4S 9}19e9 
-YJ9,] NO SUOTENIS Op JOINISIP (6661) PILAA 1° YOstop grey 
‘ssoIMeT “8 UOTOAS eT eB SUOUTUIeXd snou onb nedAled 
np J90uRd np s[dulox9 | suep % OZ Op SUTOUT op 39 “UOTONp 
-OUI.] op Z o[duioxa | suep % (QS UOMAUap gIOKOTYO 
oun UO soarapuod suoTeUISO soy ‘IsuIe) aJURYOdUIT JUDANOS 
ySO SOUDIDIJIP ke] Sieur ‘oseUUOT[HURYDS,p suUOTIORYY sop 
OI NP 3d JUDIOYJI09 Md] dp IMopuess vl op ‘sotqviseAod op 
siquiou np pusdap vag {Sa]Jo-JUOs 9] oso ofJonb sueq 
‘soovoyyo snjd Issne yUOS sala 30 ‘sdarapuod suOTeUITSS Soy 
onb Jajnoyeo & saylovy snyd yUOS DoURTQUIASTLIA Op LUNUITXeU 
np suoreunss soy ‘saydums suonenjis soo suep ‘ouoqd 
FIST Pp 
nod onb jusworjenjiqey yuoyUasaid ou 10-SoTJeo ‘stoy oun 
dJOOUd ‘STRUT ‘SqYeS So] SURP dseUUOT[HULYDE.p suOonORy 
Sd] SUOISSTRUUOD snou onb UONIPUOD kB d}eNS Sp sUISIO | 
® soguUOpsO soy] Inod sjeyNsoI soy JosIUO0D suOCANOd snou 
‘g]dunis omoyegte oSeUUOT[HURYOS | Sp sed 9] SURP SUIOD 
‘SOPI[VA JUDUIDTLSO JUOS SOXOUUOD SIOUDIOFUT Sd] 39 SOOUITSO 
sodAj-sinolia soy ‘NesAnou oq ‘olleuIpso (ad19puod uou) 
anbnsiso] uoIssaiso1 op owtueisoid un .p opie] e sasuUOp 
So] JUOUU|dUMIS JURE Ud Bes Op sUISTIO., B saguUOpIO 
Sd] JNVS “SJUDIOYJOOS saq sno} op soovoyyo sonbiynouresred 
-TWIDS SINd}eUITSd sop IUI}qQO.p s]qQISsod so [I ‘neaAnou 
oq ‘aes onbeyds mod g}ouNsIP sUIsIO., eB sQUUOpPJO 
9UN [IPO a] SUBP SINJOUT,p UONIPUOD k ‘OTHeAS oMo0jegTe 
seu] HULYOS,| B JUSUIDJOOIIP JUOPUIII,S s}ey[NSOI so] 


uoleindod e| ins segseq Sulows}-Sed SEpn}y : WO9S 


ansoje}eo ne GqX-100-ZI .N ‘epeurg onbysyeis 


"UOSR] 9}N0} Op sJUdIOYJI09 sane xne nb 
JUDANOS SUOSSOIOJUI SNOU SU snoU slew ‘osevuUOT]HURYOS,p 
suoloRy] So] SUOISSTeUUOD snou onb UONIpUOd ke ‘dUISIIO.| B 
IQUUOPIO | JUSTAIOIUI Sopfonbsoy sup SOOUdIOJUI Soy JOBLOS 
op s[dulis zoasse jso [[ ‘OUISUO.] & AQUUOPIO.] JUSTAIOUI 
no yeyNsor yno} op uoNds0x9,] B NedAnouU op ‘sopIyPA 
JUOWITVS9 JUOS pJepuLs oWUUeIsOId np UdXOW Ne suoUa}GO 
snou onb sowUR}NsEl SOOUdIOJUT Sd] 39 SOdA}-SINILID Sd] SoyNo} 
ueyiodunt snjd one-jnod j1eJ ‘oUIsIIO,| & dQUUOpPIO | Jnes 
‘SJUSIOY JOOS So] SNO} op soovoyJo suONVUTsA sop yNpoid 


uoypyueyo9 
(s) VS (iole ay aX 


delapuod uou uoyenb9s | 
op uoNNoss1 ev] uoUTgsIOoId snjq ‘UoKegpuod sunone 
sues onbysiso] uolssoiso1 op psepuejs ouwtuetdoid un 
juesi[yN ud (T) sapour oy Joysnf{ep yWJNs snou | Wey uq 
‘(JOSI[SPOUT [v.19UES Ud SUOTNOA snou onb 99 ‘sayqeLIeAod 
Sop onUUOUT UOTNQINsIp ev] op puodap sjojduioo sour]q 
-wasiviA ey onb sored ‘sonbinourered-muas yuos sopouj}oul 
S3T) (6L61 2Ad 19 SOUSIG) PIepURIS S[OIOISO] Soy JURSTTN 
uo sjonbydde e saylovy soy JOS sapoyysu soo ‘anno uq 
"SOTIQRID UIQ IOUL[QUIDSILIA OP WNUITXeU Np UOT}eUITSA ._p 
soovoyyjo jyuoWOIonUS sonbinourered-muss sapoyjoul sop 
QISTXO [I ‘sed 99 Mog ‘osepuos op uR|d np UOTRIJOgRII | Op 
advj9 | & SdTQelIVAOD sop ouNone Ins uoneNdod yy] op nesatu 
ne UoeUIOJUI p suosodsip ou snou no 39 a]duUTISs oMO;egTe 
aseuuo]nueysea sed souUOTOZ[9S yUOS SUIOUIS} sa 40 
Sed soy no aduuts snjd ey UONeNzIS ve] prloge .p suouTWeXY 


g[dulis sed : UOISIADY = °S 


‘OJUBAINS UOTIOAS PJ B ONADI Ud S}e}[NSOI $39 
suossed snoN uonelapuod op sapoyjoul soy aonb sooevoryo 
snjd yuowayjou ang JusAnad sopoyjoU soo jo ‘oIyHeNs 
no ojduns omojesye oseuuoTHueyoo sed souUONoe[9s 
JUOS SUIOUWI9} Sd] 19 S¥O Sd] NO SUOTeNIIS Sop sURP sodJOQRIS 
919 JUO sooVdIJo JOSWdIONUD SOURTQUIOSIVIA Op sopoyJoUW 
Soq ‘SB SUTeLIDO sURP SANLUIYZe JWOUSmsse }so osuodal 
eT Zoovoyye snjd uonnjos oun JoANoy snou-suoanod 
"SQOULISUODIIO S90 SUBP BdKdTTJO 
aions jso.u uonelapuod vy onb Jaye}suOd op jeIOUUO}9,s 
ou oseuUOTWUeYoS,| op uUUOIADYyD aysITeIoods unony 
‘sjamiqeyur sed yuos ou soulenxa snjd o100Ud sone sop 
¥q ‘7 o[duioxo, | suep [ mod QoQ | ap 39 ‘T a[dwioxa | suep 
I nod 90¢ op quowoAneurxoidde yso “Ym ve yodder sed 
mun Op Oe oJ ‘oyduiaxe Ivg ‘ane,] nod aTJo,nb owanxa 
Issne soid nod ve jsd splod sap uoneLeA vy] ‘SUTOUI9}-seo 
sopmja soy sueq ‘(Q] & IMoLIedns ono sed jelAop ou 
man / "Mm onb sa sgsodoid stojsed onbindure oyse1 oun) 
SOTQLLIVA Sd] JOS splod say] IS DOVOTJJOUI ONO B DOULPUD} & 
g]]9 nb ‘Te1oues usa 4so UOneIOpUOd v] Op JUSTUSAUOOUT TJ 


Ov! 


onsojejeo ne |q@X-[00-TI N ‘epeueg enbysnyes 


‘OT Te] opuvss 
ap sopme sop yednid ve] suep sosoust ong ynod yo N/T 
QIPJO P JSd UONIOLIOD VI STRUT “(€/6]) OPY OP syeINso soy 
JURSITQN Ud je} 9d op o}durod 119} suoANod snoN ‘s,epour 
np aed e soiouas juowonbysyjodAy ory uonendod 
oun Ins sogseq soMojes[e so[qeliveA sop SOoUIOU-soy]o 
JUDANOS JUOS UOMSIJIsS op soyfiqeqoid soy ‘o[Spow 
un INS gpuoy oIpeo ayou suep 4ueped JWOUI}OLNS 
‘SOXOUUOD SOOUSIDJUI SO] SITRY 
ap Jo sooropuod suoleuUNss sop osmpod ap oydurts zasse jso 
[I Guonbgsuos Jeg UoKelJgpuod ap jo oxarduios aseuuoTN 
-ueyoe ,p seo ud onbriysIso] UOISsoIsoI ve] QURINOD UOde] 


op Jowen quoaned ((OLLSIDOT) NVVGNS “(LIDOT:AAS) 


VIVLS “OLLSIDOTSD) SSdS “OLLSIDOTATANNS 
90d) SVS ‘a[duoxo sed) sonbysyneis  sparorsoid 


spuvis sop yednid ey] ‘smof sou oq ‘piepuyjs osepuos op 
uvjd yno} mod soyJo,p ayqruodsip ano ywesaop {(q)s}aog 
*xne}O] Sp INd}O9A UN so (ds enbsing ‘'d —[ = 0F soar 
Ix'x (gfx) °d (gitx) din HZ Jo/go -=(/)er no 


(r) ‘(DL UD SiA09 DL = igtro9 

« YOIMPURS >> INd}VUINS | 
IOUT]SO  SOURLIRAOD Op SOLNeUI sUIOD MUd}qo yo ‘g 
‘Q]JOO1 INITeA BT Op Moyne (gq)s§ sJoddojaagp issne suoAnod 
SNON ‘sodAj-smnaa so] mua1G0 Inod g ke yUoUA\D0IIp 
ojruyoef oy no uoOnesueoUl] ey] ronbydde suoLumod 
SnON ‘g “MoyeuNjso anoU suUOp snou g ke [esd (gJ)S 
JOXI ‘uoneoynens}sod RB] op 39 osuodel-uoU Pe] Op d9BLLIOD 
ao-yned ‘UoTOeIEs op szT]IGeqoid ve] Ip SSIOAUT,] }Sa ‘mM NO 


uor|UeYyo? 
(¢) (gi x) Gy xa eas 
Jed suosip 
‘UoT[HURYDE,| Soide Pp JOWINsd,] NUOP suOANOd snoN ‘UoHe] 
-ndod ap xnvjo} op m9jo0A uN yuoUUATduMIs yso (7) UoeNbs | 
suep (q)S ‘g op doxy Imoyea ono} mod 4ueusurepy 
(-orpuoyoidde snyjd uorssnosip oun mod 
8661 IOUULYS 19 HOSS ‘OVY MOA—JUOWO]CUISIeU dIJLIOA 
Os (1) dJepowl ay onb uoNrpuod ek ‘saysijear snjd yUSUUID}oOU 
uoneyndod op samjonys sop snos sjuasJoAuod jUOS 
sJUR}[NSOI sIMoewUINsd soy onb stew UoVendodisadns oun .p 
ised e juouepusdspurt sosuuOTWUeYE yWOS UOTeIndod 
op soyun soy onb osoddns uo] Is souR[quiasieiA op suon 
-enbe sop 188.8 []) “(Cig x+y? + D/ yx+og? = (J x)'d no 


I 
(Z) ‘= (d's) 'F = AOC IE (9S 
N 


SovUeAIns 
‘JUOLUOSUDDAI SNOS dIIP-e-3S9,9 ‘UOnRndod ev] op s;quissud | 
RB SOATRIOI UOoTyeUIWSa,p suoyenbs soy jURATOSeI Ud 
g Jose suoLunod snou sioye ‘alfLI9A 4s9 (1) JouUOTIPUOD 
anbysiso, sjspour af = ayjonbey §=suep uonendodiodns 
oun .p ised ev d911} JS9 oTuTy UONRTNdod 9y)99 aonb asayjodAy 


6EL 


suoyows snou I§ ‘ojQ[JdwWoo omy uoNnefndod ey ap 
yueusAoid saguuop sop suoke snou aonb pioge.p suosoddng 
(€861 JOpulg MOA) ajonbusa,p soguuop ap asdjeue.p 
suteroduisjuod sjarorsoid sop yednid ey suep sosdqqul 
yso Inb sogigspuod suoneunss.p suonenbs sop piepurys 
oyooidde | oIAINS ke 9d}SISUOD QUapIAd uoNdo soupy 


ISsUpUOS op UOHvAQpUOd eI op sydo1ddy “p 


“sorqeyuol snid ‘prepurys os eu] 
-ueyoe.p suvjd soy Josiyyn.p sjonjusag sudAoul suey 
suoumluexd snou ‘JudAtns mnb suonses soy sueq “xnaynod 
ano nod opouios a] stew ‘soddevis ud dsTU VI INS DOUSPIOUT | 
ouop ‘ued op yojJo,] WNpel eja_g “(e[dutoxo Jed “GQ6] [eH 19 
sivay preqneiH 0A) oddess onbeyo suep sjofns op oquiou 
9] Ned JapIeS ke dJSISUOD S}OJJO SO] LUNUTTUTU Ne orINpsl Inod 
smMoyoJoYyO suleyIaa yud}dope nb sjdurts s1sa}e.ys ou~, ‘ayINs 
ap Isure yo ‘sorqrey doy ‘d samayea say ‘szmoo doy ‘osourlyuos 
Op SoT[eAJOUT soy ‘sorqrey do.y yUSTeIJOS JUSTUUUe.NOD sayINpold 
sodA}-sinola say onb ay0s op UoTTHURYDS,p SANIAYO dI[Ie} 
RI oper yermod oddeisenui uonryswo0s ey] ‘sayuarayoo 
uou o9,p Juonbsi prepur}s soummeisoid soy red soympoid 
suoleuss soy onb oaylos ap ouusAow ke] op oimjons 
eR] Jossney juoteLMod sajqeuea UOTOIIas Sp say]{Iqeqoid soq 
‘asvuUOT[HULYSE .p uRTd np ojon.ys eT a}dWIO0d US sed pudid 
ou uo Nbsioy yuoWTjonjyIqey yuosod as nb sowratgoid soy 
sno} Jouleyue.p onbsi1 mb 90 ‘oxayduos oseuUOTHUeYNS || 
ap ojdwiod ua} op yuoWOUUOG jno} JOWIO UO ‘UdANOS 
So], ‘soxojdwios snjd oaseuuo]]HURYdE,p sopoyjoW sop 
®B IDI SUOSSOIDJUT SNOU SNoU sTeu ‘STIFHeNS NO o[durts ooyegTe 
aseuuoTHueyos .p seo ua Jonbiydde e saytovy yUOs soovoryo 
SOpOYIOU Sa] ZUOTMULYDE Pp S99 So] JULYSeS (]) S[@pour 
3] Josnfe mod ospuoid A snou snou-suoLAsp yUOWIUOD 

‘onbrysiso] syapou a] onb sayuesayo 
suloul nod un jos sayUR}[NsaI sUOTIssaIdxd Soy STRUT “(GT 007 
PIEM 38 9095 oA) odtourid us soydurts yuos xnesoues snyd 
UOISSOIZOI SP SO[QIPOW sap kB SUOISUd}Xd SIT ‘({) B[Epour ne 
omejye suoAe snou onb suosasoddns snou ‘apie | op suo] 
ne jo} Ja snuuOoUT sanoUrered sop yuos 'g 19 °g no ‘suosIp 


(1) 9 X+ = 
E eee 


eae | = {(x | 1 = A)d} 180] 


d0Av onbysSIso] sinof{no, onbso.d yso gst[WN syopour 
YT ‘SOQVIIVAOD Sop UOTOUOJ 9UN,pP SUUIOJ VI JURAR Sed UN OS 
oun oun nb seurssewl ayIqeqold vl op oJeUIq UOISsoIsOI 
op gepow un sajsnf{e mod uoyueyss,p saguuop soy 
JOSI[IN d}MsuUd SUOTNOA snou ‘yWoWTETTONIIGeH “(900T PTLM 3° 
NOIS ‘aY] MOA ‘xnomos yUoaddoysasp un mod —syueLIeA 
9199 B JUDAINS IND sjeyNsar So] Jo}depe .p aydumts ysa JI ‘WoUTS 
‘O[QvosI[SoU Sd OUdIOYJIP v] “oTqIey Jso sed op uoNIOdoid 


900Z aiquiedap ‘ajyenbua,p senbiuyoe | 


eR] IS ‘0 = A sayjonbsay mod soyrun soy mused onb 3oyn]d 
‘uonendod vj op sjquiasua |, op smsed e 9) yUOANOS js0 
SUIOLUD} Op UOT] HURYSS | ‘onbyeid US) saguUOT[HURYDSE soyTUN 
So] nod sayuenbuvur sayqeieaod sap simoyeA so] suOmMsoU 
}© ‘soqluN soy soayno} nod suossreuuos snou onb sayqeiea 
so] Soide p ojye.ys onbeyo suep uoT[HURYSS UN suOIN ‘suUTOUTS} 
ud 39 seo ud UONRNdod ev] suoyHeNS snoN ‘sonuuOoUT 
JUOS X Op SayURSOdUIOD soUTeyID0 suTOU ne nb steur ‘asuuOp 
g]qio uonendod sun.p soytun AY sop osunoeYyd mod snuuoS 
yso X Op Moyea vj onb suosoddns snon “x ‘sayjonjuaag 
SOAeOTdxd soyqeueA op moayoA un jo ‘UIOWd} UN 
yurjousp 0 = {A 30 Sed UN JURJOUDP [ = { d0AR ‘{ ‘oITeUIG 
asuoda1 op sjqetea oun suode snou onb suosoddns 


sajv.igugs SUOIPUOD “¢ 


r0'0 LI‘0 CEOs ses eo 
700 1¢‘0 Gi (ine ees 
L0°0 0s‘0 erie eer eris 
O1‘0 0L‘0 (al) ve LS 
AUMLAV ANOIIOVd AG SAT] TYOVW = ADV 


UOHOI|ES Op SoITTIqeqord 
JT nvo[gqe Ll 


(2007) 
SIOQSYeM\ 39 OURJOBHIG suep onb sure ‘([QOZ) UoWUG 
yO soyvog “Sseq “WIT ‘uosTuUsq ‘URSOIg suep sms 
SOIS9}CNS XNIP Sd OP S}IIJOI SoJLIOU Sop UOTSSNdSIP dAIA 
OU) ‘ouejosre oseUuUOT[HURYDS, | 30 oMOJeg[e UONISodu0s 
RB] MOARS & ‘SOgST[WN oseUUOT[HULYIE Pp Sopoujour sayedrourid 
xnop soy Issne JUdINSNI[I soa[q “JoMOsIP suo;NoOA snou 
JUOP So]J90 ap soaneyuosaidal Zasse JUOS sapnyd xnop sag 

“SUIOUI} 
sop InJ9d SIO} OOP UOMAUS,p xn} UN ke souUOTTHURYOS 
919 yuo seo soy onb oyos op ‘ouudAow ud ‘QQp mod | 
UOIIAUD p dseUUOT[HULYSS .p UOTJORy oUN eB PUOdSaLIOD RIAD 
"JNO} Ud SSUUOT}DII[IS 939 JUO SUIOWD} (SZ UOAUS 39 ‘9 B | Op 
alea soddeis op suoy[Hueyos sap aye} eT “(onbiytoeg np sot 
Sop OIIBUISTIO SITUSIS g]) | Neo[qe} ne uo] snd sogyuasoid 
JUOS UONOIT9S ap sayIqeqoid say] ‘seo soy mused onagid 
souonbay ey e opuodsa0s ayjo.nb uodey op s9UTULID}9p 
‘YIOTUY}9 | 19 OB¥ | UOTOS JULIA dyTTIGeqold oun d9dAv OpN}d | 
mod sistoyd 939 JUO saseUuguI sod op yuRUdAOId syURyUO 
Sd] 39 SUUIOTIDETIS jO]] onbeyd suep 91 99 ve SOseUSW OZ 
ap onbryewisisXs uojyQueYyos uN ‘sIsop sWOTxnop NY ‘JOTI, 
suep suosteul op siquiou ne oqjouuorodoid syrIqeqoid 
DOAB SOUUOTIOI9S 939 JUO (SOseUdU (Q/ UOIIAUD UNdeYO JUeU 
-Q1U09) JUDWIASUDDI OP S}OTI OOE ‘eseuUOT[HURYDS.p s.1dop 
Jomuoid ny ‘seisep sinoisnyd e oxo[duos aseuUOT]HURYS9 ,.p 
ued un uojes saiprje uoNendod vy] op onsed juesiey syueyuo 
sone soy ted sUUOTIDET9S 9}9 JUO SUIOUID} ap sfqeiedwi0S 


uoljejndod ej ins seaseq sulows}-seo sapnj}y : Wo9S 


ansoyeieo ne F@qX-100-Z1 oN ‘epeuRD onbysnyeis 


siquiou U~) “sed Q¢Z UOMAUD sUUOp ke Inb 90 ‘snjour 
919 JUO Opnjd,| oinp e.nb soguue sIoN sap smoo ne o]qQIO 
938 .p OdnOIS I] SUP SOADIOI SISUTUDW Op S¥d Soy SNOT, 
0007 19 L661 eHUS puRpjony ,p UOIse e] Sup 
SUB JNOU OP SUIOU op s}URJUS sap sTquUAsUd | 97qQIO UOTe[ndod 
od jreav spme,J (QOOT WouUST jo Ula\SIAQoYy “VeMAIS 
‘souor “WoURH ‘seOyoINO, “Joyeq OA) sonbiwopids 
suonsodoid sap yreussd oipeyeur ey op uorsseiso1d ey] sjanbso] 
Tuued sjuvjus sounof say zayd ay1SuTUSUT ap onbsiI ap sunajoRy 
Sd] JOUTWURXD Pp SNA Ud SpUPIIZ-d]JOANON LI Sp gues ke] Ans 
DYOIOYIOI OP [IOSuUOD Np jo URS LI Op o1O}STUTU Np spueUOp 
RB] B o9INd9Xo 919 B puRPfoNY ¥v oyIsUTUSL eT Op opmg,T 
Z ajduoxy 


“QUIVLLIOP 99 SURP d}IeJ SUOAR SUTOU-IOU 39 PII SLD 
onb uolsmour osomusid ey e@ puodsaiioo ji eo ‘tow mod 
olotnonsed souryodut oun jQA01 a]duroxo oulorxneap 97 
‘O88 | UOJAS ‘SUTOUID} Sop INJad SIO} QYE UOTAUS 
yur}o seo sop aseuUOTURyOS.p xNe} oJ ‘sUIOUID YOO 8 
UOIIAUS .P UOT[WULYDS UN 39 Sed YOO € UOMAUD.p UOTTHURYDE 
un guUOp & Yad ‘sue pL B SO OP SoyNpe Soy sno} op jofns 
NL SI[IONdII 919 JO SJUDIDUSIOSUdI Sap Jo QUUIOT}DOTIS 919 
B SABLUSU JOT Z & OOS Op JURUaUOD SIogsye \\-AYSJOUP OP 
UOT[HURYDS SWOTXNap UN ‘ano UY ‘presey ne sIsIOYyo sue 79 
® QZ ap oxas onbeys ap ouuosiod oun.nb tsure ‘sue p/ & $9 
Op saqnpe soy sno} JOMIIAIOUT.p ‘aTqissod np omsoul ey suep 
‘QOIOJJO 389.8 UO “(LEI BJogsyeA\) Sroqgsye M-AJSJOUNL 
op omoyegTe UONISOduIOS ap spoyjou eB] UOTAS UOIseaI onbeys 
suep souUoT]HURYOS 919 UO sosvUdIU QOS ‘SUTOUID} soy 
INOg ‘}OeIUOD ap astid aun .p ona Ud soUUOT}DITAS 939 JO su 
6b & OZ Sop odnois np seo Q¢ op omeyuoursjddns uoyMueyoo 
un 30 Sv (Sp op s[dwis omoyegye UOTTWUeYDS UN ‘UOIsEI 
onbeyd mog ‘onbsti op smoyovy soy IMs sjUsUdUsTOsSUOI 
sop 3mu9}q0 ,_p ue suOYdsy9} Jed SOMOTAIOIUT 949 UO aTvIOUNS 
uonendod ev] suep souuOd9[9s suTOUId} op uUOT]HURYOS 
un jo sue p/ & OZ Op Sodse atWOURTOUI-UOU 3dA} op neod P| 
op Jo0uvd UN .p sajUIa}e souUOsiod op UOTTHURYDSE UN ‘UOIS9I 
onbeyo sueq ‘eIOJJIP S}o[OIAR.QIN somejos syuouuUOARI 
sop oyisugjut | no sonbrydeis093 suorses MY suep s9sI[eoI 
M9 B Opme,T “(OOOT THD 39 SIeaq ‘pZ6] SiogsyeA\ 30 
JOAOOH ‘TTYyeO ‘TeyyUosoy “UowLIg ‘o3}Ie}) ue uN .p spoLlod 
oun,p smoo ne swoursu-uou sodA} op neod ev] op Joours 
Od] MS S}IJOIARIIN syUOWIOUUOARI Sop s}aJJo so] JOUTUeXA /p 
uye uonendod vy ims sulowidgj-seo opma oun 9sieor 
yuo stup-s}eyq sop Aoussy uoHoojolg yejuoMUOMAUY | 
yo gINNSUT JooURD yeuoHeN 9 “B/6I-LL6I UA 
[ ojdwioxy 
‘Tomyeu yredap op yurod un_p 713e,s [I.nb o10s op “(soue] 
-IWIS sopnys smoisnjid sp uonduosap oun Issne JuouUOp 
nb pR6] BlogsyeA\ 10 JOAOOH ‘[IYeo ‘TeyJosoy “Uo 
‘g8)Je]{ MOA) sopnye soo Josiyeo1 mod sagdope oseuuo]y 
-UPY99,P SOPOYJSU Sop xIOYS ds] IMs s[QvIOpIsuOD sOUNNTUI 


Sel 


‘ZUOB PUT AONLM)}O9S'e : [ILLINOD ‘opurle7Z-d]JoANOoN ‘| puepyony ‘pueppny Jo AjIsIoAtUA ‘soysyeis Jo JuouIedag ‘Woo Me\seTy “| 


oun nd JUO jeISoA\ OP Sonsa]JOO sas jo “SIoqsyeA 90 
‘OUILUIOp do] SURP sosI[Vo1 soIsoid sop yednyd ve] suoAcp 
snou jonbnp seAojduia xne ‘aynyysuy JooueD jeuoneN 92 
Jed so9sieel a][ayde opueis ev sapnye sap onbidA} jso sorwuod 
YJ] ‘oIpnoss1 suoynoa snou onb sowaqoid op siuds 9] 
JONSNI]I,.p ona ud sojduroxa xnop sed suosusuwi09 snoN 


sojdwaxy °Z 


(Z00Z S10qsyeM 12 OURJORHIC onb Isure 
2661 St0gsyeM ‘o[dutoxe sed “MOA) SUTOUIS} Sop UOTUD}QO || 
mod (Janonsed ud ‘amoyegye UONISOduOD eI dp 39) ad epuoS 
op sopoyjsu sop uodope | op suesnse xnedioutd sop un] 
919 & SUIOWI-IN] SIogsyeA\ oof Jeo ‘opone yuosoid 9] mod 
anbiput 3no} yofns un 4so sapma.p Tuas 99 op dsATeUR TJ 
"UOTINJOAS 
91199 op onbuojsIy Uog UN (GGG) PJeQnVIH 10 WIOY Ip 6 
onIdeyo ne eIdANO M9399] IT ‘soisop sinorisnyid ev soipHe.Ns 
soxo[duiod osepuos op suid sop juRs[yn us souUOTseI9s 
99 JO (JUdTUDTeS9 sed soy slojred jo) SUTOUID) so] ‘soguUe 
solotuiop ¢z onbjanb sop smoo ne 4Yuoumtuonbey snjd ua 
snyjd oq ‘suTOUTd} So] Itua}qo nod a8epuos op sopouj}oU xne 
Jasuod op Jomyeu nusagp sd [I ‘a[qio uoNne[ndod oun .p med 
® syneyuosoidos suOT[WURYOS sop JO1 nod sorlAIns sapoy}sul 
xne jUdI} sseuUOT[HURYOS | Op douassa | onbsing ‘(1661) 
Joepuryy 10 UPLIOATIS “UTTYSNe TOP “IopjoyorA, suep omMsTy 
SUTOWID} Sop UOTJDITIS BI IIB9I yUSTeIADp Inb sadiouud sop 
orpuoyoidde uolssnosip sup) ‘sInayoIOYD XnoIquioU sp zayo 
SUIOUI9}-Sed OSeUUOTHULYDS | op jofns ne saynop sap 9}19sns 
B SOPN}d SOUTLLIDD Op SIO] pIedd 390 B Sostid 919 sed yuoTe UU 
soyenbspe somsoul sop 4nqesp ne.nb yey a7 ‘[Uononpen] 
« a]eyUoWEpUOy sOUdTIOdxa oO eI op syeyuosoidol 
O19 JUSIVIADP »» SUIOUID} Soy 19 Sed Soy “(SRH]) UOUNIOTPY 
yp &.] SWMWOD ‘sed saz aonb ‘sayoso}01d saugU say] UOTAS 
‘uonendod sweow ve] op med e squUOTOaIIS JUOUOTIOOI 
JUSIOS SUIOUI9} Sa_ onb Jomsse.s B d}SISUOD aTUDS 90 Op 
apnjd oun yoSsu0d nb suuosiod 9yn0} JaAaTO1 yop aonb sizap 


spueis snjd sap un’T (p007 “9661) MO[serg Suep oguUUOp 3sa 
S[ONJUDAD SJUSTUDAUODUT SdS Jo S}LIOJ syuTOd sas kB 39 SUTOUIOY 
-seo oseuUoT]yueYyoS | & UOWONpoHUI qUaT[I0xo Uy 
‘oseUUO][HULYSS ,pP PlepuL}s SopoyjoUl 
sop jueslyn ud souuonNoajas yuos (jUdtIaTeSa seo soy 
UOISkI90 | B 49) SUIOW9} Soy SaT[onbsay suep UoNendod vy] zs 
sopmjd Pp sJUIONSOI o1I0d9}e9 eT ev JUOUONbIUN “UauasTogId 
snjd 40 jyuouoredde sues sopma xnenb 101 suossoaiaqul 
snou OU SNON ‘sed op UOT]WUeYOS,, suep onadid o]]90 
onb surgu BI JOS SUTO9} Sp UOT[HULYOS | SUBP SoTqeLIeA sao 
ap uoTNQLsSIp ev] onb d]]Ja} UOSe] ap oseq ap sonbrydessoursp 
sgjqeluiea sop Jed somjsep sajeys sop onuo niedal 
qUR}9 SUIOWID} Sp UOTTHURYDS | ‘« aIsMUONbey JUOWOLIedde » 
ondeA un Joystxo assind jinbionb ‘juowtrepusdgput 
SOI JUOS SUTIOUID} op jo Sed Op sUOTTHURYOS say sorjonbsoy 
suep ‘souedde uou suIoUig}-sed ddAR SapNyd So] 30 ‘SUTOUID} 
smoisnid @ no un e otiedde yso seo onbeyo sojjonbsay suep 
‘souedde SuIOUI9}-Sed SOAP SapN}d Sd] OARS & ‘SUTOUID}-sed 
sopnyd Pp SJUdIOIJIp JUOWaTeyUSUTepUO} SadA} XNOp 9STXO T] 
(1861 NeIssoD 
‘136] Usppeop 39 Lysuepy ‘opdutoxe sed “MOA) xtoyd soy Ins 
gseq oseUuUOT]HULYDE | op S109} BT op yednyd vy ap spoqTTesed 
quauaddojaasp ne onbiyswiou0ss oinjeloyI] ve] SURP dISISSe 
JUSUUTURIOU & UC ‘(a|durexa Jed ‘ayoreul ap sapnjd ‘atso[oo9 
‘saTeIDOS SOUNDS ‘AdJOUIUOD) soUTeUIOp sone xnoIquIOU 
op suep juotUONbay dsI{NN Issne 4Sd Jo SdIeI JUOS Sed Say NO 
SUOTIENIIS Sd] SUBP dOVOTJJO dSeUUOT[HULYOS .pP sIs9}e.Ns oun 
ajuasoidar aseq op uryd oy stew ‘sanbysnejysorg suoneordde 
So] IMs 1dr suOJaNUBDUOD snou snoN *« aIsojorUsprIde | 
ap }0AId » op apme,p sues 90 oyTTenb & (966[) MOIS 
Wey Uq ‘QyURS BI INS sYoIOYaI Ud soyuonbay snyd soy apnyd,p 
SopoyjoU sop oun] sd “(oIpeyeu vy sed juve souuosiod) 
« SUIOUNIS} » Soy Ted 39 (JOIDJUT.p oIpeyeu ouN jyuRyUasoId 
souuosiad so] ‘suOsIp) « Sed» So] MuIed soi JOS s}ouTsIp 
suoy]WURYd9 sop oajjonbe, suep ‘suToUId}-seo opnyd/7 


uoHdnpo.nuy *T 


‘uoyelapuod ‘yydodsonel oseuUO][HULYDE ‘JIO9]9s BseUUOT[MULYIE ‘SUIOW9}-svd SapM —: SIO SJOWT 


‘TOS Ud JoIOVUT UN ajUosoid oddeIseQuT sINjONIs e] SoT[onbsoy mod ‘sutouis}-sed soyer[Muey 
SOPN}9 SOP JUSUISAITIG JUOWIITeSS9 SUOINISIP SNON ‘soTduIIs sed sop sup sfEpou np UOTROIOEds op smo1a xne d9ssoysnqol 
op ssp Ins] suoTeduwOd ja soovoyyo snjd sapoyjou sop Issne suouTUeXS snoN ‘Uone{ndod x] mod uoyewNse,p suonenbs 
Sop soolgpuod SUOISIOA Sop Ins sgseq PlepuL}s osepuos np syoo1dde | 1so aduns snjd e] spoujow eT ‘oxo;durloo asepuos 
op ueyd un uOJas SQUUOTDATIS JOS SUIOWUD} Say SaTfonbsa] nod sulouls}-sed sapmje sop asATeUR Pp SAPOYJoU ap suOINISIP SNON, 


suins3y 


, 9096 AeISeTV 


uonendod vy] ans sogseq SUIOUI9}-S¥d SOpnyy 


LEelL 


anBojeyeo ne GdX-L00-ZL .N ‘epeued anbijsije}s 
Lvl-Lel dd ‘Z WN ‘ZE IO 
900Z auquwsedep ‘ajanbue.p sanbiuyoe | 


ansoyeieo ne GqX-100-ZI ,.N ‘epeueg onbysyeis 


and9|9p Joyo Ud anajoepoy ‘JoyURY| Pjorey] 


‘AOAING UONLUIUeXY UONLYNN pue yIyeoH [euoneN ke] op soo 
SOQUUOP Sp Spre | & soonyeAd JUOsS o[dy[Nu UONendut,| 39 s9sodoid apoyo eT ‘onjoxXd UONeULIOJUT | op 
ansed oun ormnpep op jouttod mb 99 ‘sanjoxe suoysanb xne sasuodai sa] amped ap Juoyourtiod nb suonsonb 
sop ouusidwio0s omepnusoy onbeyds onb mod onduod jso spoyjou eT ‘presey ne sisioyd syuepuoder sop 
eB Josod e suonsonb op d[quuasud-snos Un jUdTUOS oMTe[NULIOJ onbeyD “[O1oL.NeU ISepUOS op SoITe[NULIOJ sop 
19919 op JURYOULIOd spoy}oU oUN d1OQeRI9 JUO SIMayne sa] ‘asuodal op nevapIey 9] oIINpol op ue JUepuodsr 
onbeyo e sagsod yuos suonsanb op a]quIasud-snos UN [Nas ‘JaloOLneU ddepuOs op urd 9] sue ‘sayUenbueUT 
sMo[eA Sop jUo}UOSoId ‘JOIOLNeUI osepuOsS op ud UN,p asneo ev ‘Inb saguUOp sap JosATeue nod s{dnynuu 
uonendul | e smodaI yO UOSUYOL Jo Jjozjey “oyuayoS ‘UeYyeUNYysey ‘sewoy], ‘sponse Ime] sueq 
NKOATU Seq op xd ap sorpUT | aIINpoid nod gsijMn (sone sop suusAow No onbinaut09s 
suusAoul ‘souUsAOW Sop one1) MajeuNsd,, wos onb jonb seo a] 4sd,dq ‘o]qQId sUIIIsd Jyepedns sorput 
INOTIOuU UN sUUOP ‘sTUP)-s}e1q Sop d\sT[IGegoid sseuUOT[HULYOS Jed oyooidde | anb JoLso1 snjd suuostel 
x1oyo Jed oyeysenui oSeuuo]nUeYoe un ‘oseyuvaep oyodut mb 90 49 asnamosi snd uoNeoneNs oun 
asoddns nb ‘tup-owmneAoy np sysoidde | ‘satpnje uoryendod ey mod aonb yuanyouos sj ‘sonbrydeisourss 
soguUOp soulgt soy ms jueAndde.s ud siup-s}eyq sop oa]joo 39 Wpy-ouNvAOY np UoONeUUOSUOD 
PR] & XLId Sop SdIpUT | Op dISOTOpoy}sU vy] yUOIedUIOS uewuso M20 JoAegyq ua] UeUyIOG ‘afore May sueq 
‘JUOUUOT[ANjOe SEsT[HN yWOs Inb souK,QuIdSIeIA Op WINUWITXPU Np sind}eUsS 
so] onb syeynsor smoioul op yuouuop sasodoid simoyeurtjso soy onb oQUOW UOT}e[NUIS sp spnyd.7T 
‘ued 9] ms s9seq ajsquonbey sysoidde aun uUoyjas SOOUdIIFUT Sdd JUOJ sane soy ‘onbysyjodAy sTapour np 
soquo.a suoneoTioads xne saysngol yustos uoKefndod ey ap aye} ev] Ins soousrgyur say onb mod ‘yuepuadad 
‘uonerndod op ayjiey op sinoyeujsa sap olmnysuod mod suustsokeg oyooidde oun e smModel yUO SI ‘oy 
99 INOg ‘sUdT] sp o8e}sIdop Jed sseuUO][HULYS,| op ayURLIeA OUN JUOUTUUeXO UIpIefuOP 39 BUIPS|A[-XI[9] 
‘[IeJOp Ud JUSATIOEP PJ 39 SaTJO,p oun] & yUOWOIOTPNOTIed 
snjd uonusye Ine] jUazI0d snane Sa] ‘SOITBSSID9U JUOS SPOUJOU LI & SUOISUD}XS SOUTL}IDD “}919}UI .P 
sonouesed sop SuUOT}RUIT}SO Soy I1U9}go Inod segsI[N 3Ss9 splod sop oseyied np s9sI[eI9UaS SpoyoW 
Pe] oyjonbey] Inod joompur asepuos op uoTyeNjzIs oUN SUBP DUOP 9ANOI} 9S UG *Sd}S1INO} xne JUoWOTed1ouLId 
SQUTSOP SOOIAIOS Sop JOUUOT[WULYDS ._p JUdIOSSNs sIMoyne soy ‘oua;qoId 99 JoUINOJUOD MO *Sd}STINO} 
SO] JUSWIDJOIIP sIpUINe.p JUReyoWIod asepuos op aseq ouUN.p sOUaSqe,] 389 soJonbud.p odd} 99 
Jed 9sod jedroutid ourayqoid a] ‘anbystimno0} uoneyuonbsy vy] Ins sJanbusa oun .p svo o] suRp UOT}eUIT}SO .p 
spoyjoul oun.p jo o8epuos op uvid uN.p UONeUMIO}Np ke] JUDIPMID puURIJog-AUNRYY 10 SI[IANG 
"SJUBSSOIOIUT 
sojduiaxa sonbjonb oodae at109y} IMe] yWaNUOWTSP simone soy ‘ayeuNdo sud] op soINeW sun 
B SOJULSIJJNS 19 SOIIESSID9U SUOT}IPUOD Sd] JUDSSTUTJIP 39 SUDT] Op soLVeUT eT Op sojorIdosd soyuRyJOduIT .p 
JUSUTLUBXd S|] ‘STRIQ SUBS }IOS UOT}eUIISa,| onb nod sualy sao a1apuod nb yo afqro uoNeindod ey] ke sot] 
yUOS sQUUOT[HURYSE UONeINdod ve] ap syUdUTETS Soy] JUOUUUOD astOoId INb ‘jooIIpUI OSepUOS ds] SULP SUdT| 
op soljeul oun .p ydaouo09 jueyoduil | USSsTUTJEp S|] ‘jOoTIpul osepuos ne sonbrydde sprod sap oseysed 
Np spoyjouwl e] op xneigUas sonbri109y} s}UsWIApUO} soy JUdJUaSoId “Jed Ino] Inod ‘agTTeAvr'T 30 d]]IAOG 


ou@uunu 89 sueq 9€L 


‘Oxf UOISIOOId Op NKSATU UN UOTAs JULINSOI UOT[HULYIE ,P SaT[Ie} Sop UOsTeredu0D 
aun 30 OX UOTTWURYOS.p ale} UN UOTIS jURINSOT (AD) UONRURA Op JWOIOYJooo np uosteseduios 
dUN : SOLIPUDDS XNIP UOTOS sodredUIOD JOS SapoOyIOU SION soy ‘SoT[Ie} SoyUOINTJIP op soanoy suoneindod 
buro op uasouw ny “(7O0Z) yezoy Jed ssodoid uonesmundo p suyyWOS]e | 19 (8861 NO[SoMprIH 10 9gT[eAvT) 
NO|[SOMPI-[ePavy] op uy osye.| : uonesmundo sed soyooidde xnap soe ‘(p~OQ0Z) URSIOY 30 SuTUUNH 
ted sgsodoid ‘uonvoyneys op onbinsuioss oyooidde | yuoredt0s euLIaA 39 YeZoy ‘opousJe moj sueq 

‘uoder ne / 66] Ud s9UNW Xd soy Ms oTeUONeU djonbuU_ | 9p SoguUOp sap 
asijyn mnb say] UONR[NUMIS op apnyd ouN,p opie] & IdNSNIII 3So OpoyjoW BT ‘suOTROT|dWWOS op doy sues 
osvuUo][HURYdE .p Seisep op siquiou jonb syoduit.u e onpusjs ag ynod yo Jonbydde ve aydurts yso sasodoid 
spoyjour ey ‘oisop onbeyo ke asiyyn 4so OsMUOI sues o[duMIs oMOyegTe oseUUOT[HULYIE | onbsJo] de.ys}ooq 
SOUBLIBA B] OP SaJUSIOYOO SUOeUIT}Sa sop suUOp Inb TTNouJeg 9dA} ap deys}oog spoy}our oun yuasodoud s|] 
‘SopuvIS JUOS OSEpUOS dp sUOHOLY Soy onbsio] soisop smoisnyd ev syHeNs dseuUo][HuLYySE | suep de.ns}ooq 
SOULLIBA Op SINIJCUIT]SS Sop UOTSTTNN | Ins yuoyouad as eploy 39 JONIS “OsIeg “eyorun, ‘apoTVAe M9] sued 

‘g]qQvsOUsI }so asuOdaI-UOU eI d]TJonbe] UOTAs oTJoNyIQey dsoyjodAY | 
ap SUONIPUOD xne oIIe]SHes & dIOTULUT Op ‘asepUOS op ULI Np so[qeLeA soy JoNorsed ud ‘sagyndut sopqeiea 
XN SOdI]_ SO[QVLIBA Sd] SojNo} sINdOIpsid SUTUIOD SIMJOUT v JOIOJUT JUSTeINe smMoayndutt soy aonb yUsn[IU0S 
SINdINV SIT *Sd} XIU S}JOJJOo B NO Sox sjoyfo B S[OpowW uN ,p Uddou ne UOHRINdUII.p sJapour 9d] suRpP SoTquLIeA 
Sdd JULNIOUI Ud s}INpeI ano yUdANod sjatjudjod steiq say onb yuaNnuOW sT] ‘aydyH{Nu uoNeNdut.p 9}3xo}U09 
un suep uoneindul,p sayapoul op uoneloger]s,| op SIO] asepuos op urd np soqelea sop ajduroo 319} 
sed ou ap saouanbesuos say juorpnys AouUry 30 URYeUNYSseY “Joya “UOTJe[NUUIS Op opnyo oUN,.p apie] V 
“sqqueyiodut suolsonb soureyio9 op askyeur 
oun 39 onbruidura ayduuaxa un 998A yNJOUOD [J ‘UONestwWoOpuPI-Isenb ap sjapowl UN,p UONUOJ Ud d.NzIBANO0D 
op sINde soy] Jo soyUN soap osuoddl-uoU ke] B SONpP SIMI so] JOSLUOD mod asxr[eVd ap apoyo 23300 
ap sajatidoid soy oynsua asAyeue [J] ‘ase[eo op s[vIOUdS UOTOUO] PI & [ePUILS ap 3d OARISY,p d]JoUUONOUO; 
MUUIOF KT op oyooidde | pWSIej9 Jo oseyeo Jed UOHeUINSD,] op o[e1oUas UONdUOsap ouN suUOp I] ‘omMpIdAN0d 
op jo osuoddl-uoU ap sINdLa soy JOsLU0D Inod asvyeo sed uONeIopuod ev] suTUeXe YOY ‘ued es Mog 
“SO][MUIe] Sop Ins 
yueyiod sulous}-sed sapnyd sop UONsonb vy] JUSWIDAITIQ SUTLUXO II ‘JUDWIDTLUL ‘ASSaysnqol ap jo gy1OKOYJO,p 
sqetidoid soy anuowsp ji ‘soydwiexa.p opie] YW ‘ouIsuO.] e& s9UUOpJO,| Mod s9gsIeIq sie ‘soROTIJO 
snyd uatg 39 a]durIs osueYyooI op UOTNTOS oun aymnsuo asododd |I ‘souR[qUIOSIeIA Op WINUWITXPUT NP UONRUINSO | 
dav oISOTeUL UN jyURSSITQe}q ‘seo xne ong s[qQIe} Zasse splod np UOSIeI Ud sooROTJJoUT JUOWUTATQessed 
a9 Jusanod ajonbua | op sagrapuod SUO}RUISS soy onb aNuUOUap [I ‘onbiysIso] UOIssoIsa1 Be] Op o[dWIOXa | 
yuesT]yn uq ‘oxo;du0s asepuos sed syonbus oun p ed e snudygo JOS suTOUd} Soy SaT[onbsay nod sutows9} 
-Sed sapmje sop olen yoog ‘« UoNRndod ve] ms sogseq SUTOUID}-sed sopnyq » s[NIQWUI sfOIe UOS sueG 
‘souue 
91109 op SloqsyeM Xd np spose | op Moyne SUIWUOS OSS Ae\seTY ISIOYD MOAR p — JoT[N.J oUAB AA 39 IYO] 
uoIRVYS ‘oUO\syoRIG UOpJOH ‘juopisoid ‘osnoyj[ag PIAed — UONIITIS op dIWUOD Np SdIQUIdU Soy] JOTOIOUIOI 
SIBIOUNL ff “OWOH/(0' [/INASUsIC/B10 prjonaysaloid//:dyy e opqruodsip JayIeypy plaeq jd UlaysuesIoyy plAeq 
Jed ,“Sioqsye A Ydosor YIM UOTSIOAUOD V,, (€ ON ‘ST JOA) 9OUdTDS [eONSHRIS Op dJONIe | TOA “BJOgsye 
ydosor ap dJANIO J 10 SIA YI INS SUOTRUTIOJUI .p snjd Mog ‘das eT ap spore Jomusid a] Issne yeyUsso1d 
mb ‘[9Qz umf op o1sUMU oOU sUEp sartqnd 9 e BIogsyeA\ Ydosor op otydeBoIq dAdIq DUA) “SOOT 
JotAuel Ud oNUdAINS UOHedsIp es suoUsTINOS snou onb assaqsiy ddAe 4S9,cd “SJOgsyeA\ Ydosor ke d9IPap 
SQPIOTJOS SfonuUR SO[OTTIL .P SLIOS PI OP [Oe OUIIXIS 9] Jed aynqop ajanbua, p sanhiuyra] ap o1gUIMU 9D 


O.19UINU 39 SUB 


anbojeyeo ne GdX-L00-ZL .N ‘epeued anbijsije}s 
9eL-SeL ‘dd ‘Z N ‘ZE “IO 
GEL 900Z eiquwad=ap ‘ajenbua.p senbiuyoe | 


‘V86L - 87'6EZ ISNV *.Slevaley\ ‘V86l - 87'6EZ ISNV ‘sjeueley\ 
Areiqgi] payuuidg 10} Jedey Jo BOUBUBLUJAd,, — ,SBOUBINS UOITeW Asesgiy] pau JO} Jadey JO BOUBUBLUIAY — S8OUBINS UONeW 
-JOJU| JO} PUBPULIS |PUOI}EN UBDEWY,,,| ap SeyewUIL SeoUaHIxe -JOJU] JO} Puepue}S seuONeN UeOeWY JO S}JueWaLINbel 
xne puodes uoneojqnd ajueseid eB] suep asijijn Jaided a7 WNuwIUIW au} sjadW UOl}edI|Gnd siy} ul pesn Jeded auL 


angojeyeo ne {dX-[00-Z1 oN ‘epeueD onbyysyejg 


5S7 AOR R Ree eee ee eee eee a ee eee eee EH HOHE HEE OEE HEHE ES EEEE EES OE EES ESE OEE SEES EEE DES EEE OEOEEHES SOS OESESOSESHEHESESEOESEEOSE SEES OOOH ESESEE EES ESS SE OEH EEE SED EEE EE EEE EEESE SEES SEES SJUDUIITOIOUUDY 


IpZ eee eee EES eee e eee eee eee eee eee eee eee eee eee eee ee eee eee eee eee eee eee eee eee eee eee eee eee eee eee eee eee eee reer eee ee eee AdAINS uolyeuTWeXy uOnLyNN pue uyeeH 
[euoyeN eI op yuRUDAOId SogUUOp ap spre | & [SIOLNLUL OSeUUOT[HULYDE ,P Sopoyjol Sop UOHENyTRAS ou) 
uosuyor "T ployfI[D 10 JJozyey “f UoIAP “JoyUoYoS JorueyjeN “Ueyyeunysey “q OJOT[OAL], ‘SeUIOU], [PON 


LIZ Pence eee eee e eee ee eee seer seer ese sees eee ee esses esses sees essseseneessseesseessesesee UOT}EUTUUOSUOS eR] e xd sop SOOIPUI So] Jnod osepuos op suv] 
ULUIBI AA PIVMP 39 JOABIT “D BIAIAS Ua] SoTURL “URUUTIOG “H UeRTY 


VASES ee ae ee suusIsakeq Qpoyyoull P| qed 91SISSe ayooidde dUQ] : SsayoRo suonejndod ap d|]Ie} ey 
Jouitjso nod saddeis us sdeuuOT[HUPYSS ,| Op 39 SUdT] ap o8vRjsIdop Jed os euUOT[HULYDS | Op UOSTeUIquIOD 
UIpseluo|] “gq Opa 19 PUIPS|-X1]94 “H UR] 


LG OUISLINO} 9] SUep sajonbud xne UOTWeoT[dde UOs 39 JOOTIPUI OSvUUOT[HULY ,_P 9poy}oUr BI op SUOTSUD}Xq 
puesiiog-Aumneyyy WeLIAy] 39 O][IANG apneg-uesr 


SI sere ccc eneeececeecccceseeesseseserecesessssseeeess sprod sop oseyied np desT[e1oUds apoyjoul e] op s}USUOpUoy SY] 2 yOOIIpUT asepuos 
ID|JCAV’] ILI 39 VIAN opneyy-uvor 


LEN Pome eee eee ee eee eee eee reese reese e eres ese ee eee ee ee EE EE HOE EEE EEE ESESE DEES ESEEEEEEHEEEEE EEE EEEEEEEEEEES ESE EEEEEEEEE EEE SESE EEE EE ES Qed JO | op uosteredui0s our) 
: uoryestutdo sed yo onbrysuioes spoyjew oun red uoneoynens ej op oyooiddy 
PULID A WIRY Pol 39 YLZOY Uloleyp| 


691 See e eee eee er eee seen sees essere esessseesssesssceseseeseee soisap smartsnyd e oyneys oseuUo][yULY9 | jmod TT][NouIIg ody op dens}oog 
eplo,, WO MS] 39 JaNIS “Y Apuey ‘osres rysomP “eyorun, orn 7 


19T eC eee Cree eee eee ee eee rere er ee Cee Creer eee rere reer rere errr er eee rere eee eee eee ee Cee eeeereeere eee eee eee rere eee reer ee eee ere ee eee eee ee eee ee eee eee eee ey soyuenbueur saguuop Sd] 
Jnod sydnynur uonenduit | suep sseuuo]]Hueyos .p ued np uonestpopour ey op souryiodult 7 
AouUry Y Jeyeyyes jo uvyyeUNYSseY “q SIOT[OALL], “JOWOY ‘gq oWOoIoL 


Ove eae OINLIOANOD op SINILS Sop 39 asuOddI-UOU YI Ip UONI9.LI09 ve] Inod asvyeo Jed uONeIpuoOd YI op UOHesSITN| 
noy Ss did 


sisdeg 1vnsay 


FIA Ri cee Soe ges cece ah panama oc eT APPS Ghia Ha Recta uonerjndod BI INS sogseq SUIOUID}-Sed sapnyq 
OOS Ie\selpy 


BAIQSYCAA YITOS 9pPH-LV 
ey We tcc sc ee stnesitrs 
SI1IVUI SOP a[quy 


900Z S1quId.9p ‘7 OIOUINU *Z7E SUINTOA 
epeuey onbiystjV19 Jed 99}Ipa onAdI ou) 
dj9nbus.p sonbruyso 7, 


"BO"URD]E}S MMM 
: epeued onbysyeVIG op JOUIDIUT oYIS d] INS soyqruodsrp yUOS sonbIUO.QIE]P SUOISIOA Saq] ‘d9agGaNC) NP sUdIONsTWeIs Jo soUUDTONSIVeIS 
Sop UONRIDOSSY | 19 BpeURD Np onbysneig 991908 PJ ‘YOIeasay uoruTdY sI[qng JOJ UONRIDOSsY UROLIOUTY | ‘oJjonbuq,p susionsneys 
OP IPUOTLUIOJUT UONRIOOSSY | ‘UONRIDOSSY [BONSHRIG ULOLIOUTY,] OP SoIqUUdU xNe LIOJJO 3Sd yNpor xUd up “vO"UeD}e}S~M)JOp1O 
JOLNOD sed NO FE/6-688 008 | Ne mordosgjay sed “EEOT-OOL 008 I Ne ouoYydy|s) red ZopueUTLOS NO 91,0 VIX epeueD ‘(oueuO) 
emeng ‘Aouuny sig Np speuswiolg QS] “UOHRNIIID ek] 9p UONSdH ‘UOISNJIp ke] Op UOISIAIC “epeueD onbysynejg e& JUOWOUUOGe.p 
opuewliop oNOA IudAred sey op dog ‘(Someduiaxs Z x $ ST) WO $ O¢ ‘shed sonne ‘(somejduioxe Z x ¢ 9) WO $ZI stun 
-sjeyq ‘epeued np Ind119}x9,| B SIOAUS xne JUonbidde,s someyuowstddns uosIeJAl] op sted{ Soq] ‘SOUUDIPeULS 9JUD9A Op sSoxe} Soy sed 
snout u xtud a] ‘aguue sed WO ¢ g¢ ap Iso (andojeyeo ne GgX-[00-ZI JN) aanbua, p sanbiuysay, ap soumtiduat uorssaa vy op xd oJ 

jusWIUUOqY 


‘ONAL B] SUBP Sog}UESoId SaATOOIIP 

SO] JOYNSUOD ZOT[INDA ‘JeULIOJ oJ INS SUOTONSUI so] Nog ‘(9LO VIM ‘epeueg “(ormeuC) ‘emeno ‘Aouuny s1g np speuswolg OS] 
‘epeurg onbrysneis “vo uRr9}e]sM)OLI) ‘Joyo Ud INAOepsl NB PJOAA Ud JUTUDTQVIOJOId Jo onbruO.OS][S JULIO} Ud sTe;Ssue ud no sieduey 
Ud MusAIed oMey do] & SOPAUT JOS dpONIe UN oNTeIed oI} JURIISOP SINojNe so] “Ue,] SIOJ xnap aetjqnd ysa ajanbua_p sanbiuysa] 
aNAdII BL ANd $a}x9} 9p UOHRUISI1g 


‘epeued onbysyeis op TU UOT}OePal OP 9}TWOD Np SoT[90 JUNWOITessod9U Sed JUOS dU ONAdI BT SULP SasTa sUOTUTdO Seq 39 9}xO} 
Ind] op NusJUOS np sayqesuodsal jUSINOWUAp sIN9yNV soy STRUT ‘oNbILIO 9UN & SILUNOS JUOIAS SO[OIVAIe Sd] SNOT, “SdT[9e1 SogUUOP sop B 
soonbrydde no saguuop ap 9309709 ev] Inod sagsiqyN 939 JUO Inb sapoyjoW op UOHeNTeAD,] & Jo UONLIOgRII,| & 99P1OIOR 489 oIOTTNOWIed 
souryiodum ou ‘sasiyeigues sowigyshs op yuowoddojaasp 9] 39 soquUOp op asdjeue.p jo UONPUIISO.p sopoyjoU soy ‘sonbysye}s 
soguuop op uoneisajur.] ‘sonbrydeisowep sopnjya soy ‘UoTesITeuUOsTesop ey] ‘sonbisojouoIYO solias sop osdyeue.] ‘ojgnbua.p 
SOpoyJeU Sa] INs oyoJoyoo vy] ‘sajgnbue sop uonenyead,| ‘sojgnbue so] suep siMo1a so] ‘d}09]]09 Op sopoyjstu op jo soguUOp 
OP SddINOS sayUdIOZIP op uoyestyN,| ‘onbyeid o1pso.p soyuleUOS op URTNOIep UONdadU0d ap saaTqod say ‘ayduuoxo sed ‘ouWIOS 
onbysyeis ouistuesio un jUassoIgjuT Inb sonbyysye}s sopoyjow sop syoodse SIAIP So] INS sopore sop atjqnd ajanbua,p sanhiuysay, 


NOLLOVGaa Ad ANOLLITOd 
ppouvn, anbijsyojs Bunz ‘Ay 30 Jonopg-ulqny ‘Ss Yer *Z ‘ezizey ‘q Iq ‘d ‘juowmnrog *4-'f 
IMIYSUT JDIYSUDIS UDIPUT ‘ORY “f° L 


sjurofpe sinsjIepoy 


AJISABAIULD PADAAD HY ‘AYSAR[SCZ “VW 

oojsajpy fo AJissaaluQ) “AN “Dd 

AJISAAAIUL) 2JDIS BMOT ‘IONONM ‘W'S 

DUAL Ip IPNIS 1]8ap BIIS4AAIU) “RWI “fA 
upsiyopy fo Missal ‘WSdf ‘yeyleA aX 
Jaipyonan ap ausdaaluy) “SqILL A 

oopsgjoy fo Aissaaiuy) “uosdwoyL ‘WI 

AJISABAIUL) ISIPOYJAP UABYINOY “SIYOIS “TJ 
Bu0sUO]OY JO ApISAaAluy) “JOS ‘q 

Ajissaaluy apis o1ycQ ‘Kuseys “q 

uojdupynos fo Apissaaluy ‘IOUUTYS “[°D 

AQUA) YIADASAY UOIUIdGE) JOUOIJON “UdINSYOS “f° 
SIISIDIS YIVAL] A0f AaJuay JOUOLIDN “IOYUSYOS “N 
[DADT ajissaaluy) “SIAN *d-"T 

AJISAaAlUuy.) AYN “IOWY ‘£ 


Ysuls ‘g's JeYd Wd .ma7depe1 UsIDUY 


ymooury “yA 
Joyueyl “H 
IBAOY ‘ff 
souor “Yy 
OUIQUIRD ‘f SdIQUIdyA 


AJISAAAIUQ) UOJBJADD “ORY WNL 

DAA] Y JO AJIssaaluy “peselg “N'D'N 
AISAAQAIUQ MaAgay] “UURWIDJId “G 
AissaaluyQ Madsgayy “ueuyeN “D 

ppoun,y anbysyvjs ‘ooyear’T 

punjdunyy fo Apissaaiurly WSdLf WyRT “d 
JIIAAIGY SIYSIOIS JDANJJNILUBP JOUOYON WO ‘d 
DUT jojsayy “surypne ‘q 

SIISIIDIG jou 40f a1f{E “no[soMpiIy “VW 
ppoun,y anbysyvjs ‘ourquiey ‘¢ 

AJISAIAIUL) AIDIS DMOT “ITO “VN 

SOISIIDIG A0gvT fo nvaing ‘$7: ‘osun{ 7A “Tf 
snsuay ay] fo nbaing ‘$A ‘JoayueD “g 

‘OU IDISeY “OU Wf 

ppouvn,y anbysypjg ‘Iopulg ‘V'd 

SHIIOSSE S.ANI}JIVPIY 


ppouny anbysyojs ‘joyuey “ gNSayap Joys us Anajdepoy 
ppouvy anbijsiyojg ‘1eaoy ‘f Joyo Ud ANI}IepIy 
NOILOVdaa Ad ALINOO 


yoveld “A 
suO|sypoRlg [°H suspisaad suspuy 


a0h0Y ‘C yUSPISI1g 
NOILLOWaIG Ad ALTNOD 


‘Spoye] OALITENC) UI s}UI}UOD [eUINOL jo ‘soNsNIS 


0] XOPUT JUdLIND sULP sddUDdIEJOI Soy JOANON ud ynod UG “AjISIOATUA) sNUUSeI ‘ASOTOPOUJP YOIvasoy [eIOOS Jo aseqeieq 
WHS 39 sleusqy spoyepy pue Alooyy, jeousneis “ueIoNsneig AdAINS oY, suep s91JO}Jod9I \so ajanbua,p sanhiuyral 


epeuey onbrystje1¢ Jed a9}IP9 ONADI OU) 


ALANONA.d SANOINHOAL 


ppeur) ecg oA HN 


| 


eMe}O 


Sv00-71Z0 NSSI 


S||BUJSOWAS : BPOIPOM9d 
enbojeyeo ne GdX-100-Z! oN 


900¢ 8Quis09eq 


‘910 VEN ‘epeued ‘oue}UD ‘emeNO ‘epeued enbisieis 
‘ QJ9]UAIJO |] E SBDIAIOS SOP UOISIAIG ‘S8OUADI| BP 104}00,P SBDIAIBS XN 91109 UOISSILWIEd eB] JeBPUeWAP PJOge,P JUBAIOP SINE}esI|IIN So] 
‘\uowany (s)ebed je eousse}91 9p epoled ‘oJ@WNU Ja aUUNIOA ‘anBoyeyeo ne OJQUWNU ‘jINpoOId Np WoU ‘UOH}edI|Gnd ep seuue 
‘epeuey anbisneis : (nai 2 A IIS ‘« ap ajdepy » NO) BdJNOS : }INS BWWOD BE}ID 94]9 OP SA9UUOP SEP BDINOS zB] ‘Sed 9] }SA,0 IS 
‘JUBWB|NGS S8|CIOJBLWULUOD UOU SUI} SEP & JIAJAS HOP UOIJE}U@WINDOP 9}8d “}INpOJd Np s}e1jxe saulejUdWa|dWWOD s}jUaWeUBIesUa Ep 
SEd}ILUI] Sey]UeNb ap UO!}eyO B] SUUdWON A ‘saeshjeue SBD BP SUOISN|OUOD ja S}e}|NSE1 ap UO!}EOIUNWWOD e| SUeP je SesAjeue Sep SueP 
nueUuod Np uolyesi|11N,| PUesdwWOd UOISSIWad ByeD ‘SeAeONpaS sulj Sap e No ajeJUSWaUJEANOH anbizijod ap no ajjauuOHesiueHio 
‘Q||aUUOSIOd BYDIBYOOI OP SUI] SEP & ]JUBLUAINES SEeps0dde jUOS JINpOJd 9d Bp NuajUOD Np UOHesIIIN,P Se|qeuUOsies S}OJP seq 


‘Q0U90I| BP INe]Us}E9p Np elusiuebo,| ap ineis9}xe,| e SuOIyesiUeHsO NO SauUOSJad Sap ke SiLUSUEJ} NOE JINPOJdad auj}9 


nad au yinpoid 87 ‘seAsesed SOUP SNOL 


9002 ‘SlJISNpU],| OP SISIUI| © 


epeuey aenbiisieis ap ajqesuodsas 
SUSIUILW 8} Jed Basuojne uOHeo|gnd 


Z O1IQUNY e ZE2UINJOA e 9Q00T 2IqQUIZN0eq 


epeue’sy onbysneis red 
II"P? 
ONADI OU 


S}yOnbUI,p 
SonDIUUDIL 


ppeued 2 ae we 


yonbusa,p 
SonbIUuUydIL 


At t a 
Dart we ie 
Vt a 


o Af ry 

ja NK 

: “i 
mh 


q4 


ARI nec ’ 
a ary ies ue ae 


a oa | ry : ae ie 
ink SU, «fb Se v8 ee re 


 % 

ee} 

D's 
i 


: ” * 


i a pr 


ar 


os 


an , 
m ¥ { 
ra 
y 
i 
! 
7 
in 's! ve | 
be ( . | 
: | 
an | j | | 
: ‘| Bah | 
ian FT| \ i | 


Ah 


1 a ‘i 
ey v ey 


4 1’ eo 


Sate att Bae 


SITS esenrs eeeeurdesusyrecnny, 
as SUNS sO men tame 
Re sad teed. on an 


